00000001:02000400:1.0F:1789185343.891947:0:2953:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_hostid 00000001:02000400:1.0:1789185351.983891:0:3155:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789185353.018776:0:3216:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1271 MB/s 00000001:01000000:3.0:1789185353.268893:0:3216:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1639 MB/s 00000001:01000000:3.0:1789185353.518510:0:3216:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10283 MB/s 00000020:02000000:3.0:1789185353.835215:0:3247:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_40_g357d090 00000400:02000000:0.0F:1789185354.222149:0:3262:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.154@tcp [8/256/0/180] 00008000:02000000:2.0F:1789185356.659321:0:3411:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1789185409.232785:0:5212:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789185420.349092:0:5804:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789185420.349097:0:5804:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789185420.349232:0:5804:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000007655112a 00000080:02000400:2.0:1789185420.349242:0:5804:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789185420.361443:0:5804:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789185420.361974:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789185420.362023:0:5804:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000aec93587) 00000020:00000080:2.0:1789185420.362052:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789185420.388197:0:5804:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789185420.388664:0:5804:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789185420.407017:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789185420.407140:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789185420.407167:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789185420.407217:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789185420.407242:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789185420.408338:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789185420.408348:0:5804:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789185420.408362:0:5804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x532743011272b64f 00000020:01000004:2.0:1789185420.408371:0:5804:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789185420.408376:0:5804:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789185420.408381:0:5804:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007655112a from MGS 00000020:01000004:2.0:1789185420.408385:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789185420.408396:0:5804:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000096542ea0) 00000020:00000080:2.0:1789185420.408551:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789185420.408616:0:5804:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007655112a from MGS, refs=2 00080000:01000000:2.0:1789185420.408621:0:5804:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789185420.408627:0:5804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x532743011272b65d 00000100:00100000:2.0:1789185420.408737:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789185420.408865:0:5804:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789185420.408871:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789185420.409431:0:5804:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789185420.409447:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789185420.411002:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789185420.411287:0:5804:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789185420.411294:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789185420.412764:0:5804:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789185420.412778:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789185420.413290:0:5804:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789185420.413297:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789185420.422662:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185420.422671:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185420.422672:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185420.422934:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185420.422937:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185420.422938:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185420.423795:0:5804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789185420.429548:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789185420.673660:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3063 MB/s 00000001:01000000:2.0:1789185420.923861:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2195 MB/s 00000001:01000000:0.0:1789185421.175402:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 354 MB/s 00000001:01000000:0.0:1789185421.425498:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 811 MB/s 00080000:10000000:0.0:1789185421.435244:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1789185421.457433:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789185421.457488:0:5804:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789185421.457504:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789185421.457507:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789185421.461309:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789185421.461510:0:5804:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789185421.461584:0:5804:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789185421.461851:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789185421.461877:0:5804:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789185421.462241:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185421.462489:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789185421.462496:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789185421.463606:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789185421.463616:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789185421.463974:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789185421.463981:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789185421.465207:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789185421.465240:0:5804:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.154@tcp' 00000020:01000004:1.0:1789185421.465243:0:5804:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789185421.465299:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.154@tcp (typ=mgc) 00000020:00000080:1.0:1789185421.465325:0:5804:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.154@tcp (0000000023f393c8) 00000020:00000080:1.0:1789185421.465346:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789185421.465501:0:5804:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b835d625@MGC192.168.202.154@tcp: add connection 192.168.202.154@tcp at head 00000100:00080000:0.0:1789185421.465710:0:5818:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1789185421.466213:0:5804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.154@tcp-0 is initialized 00000040:01000000:1.0:1789185421.466226:0:5804:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789185421.475511:0:5820:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789185421.475679:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.154@tcp (uuid 8ad68fcc-785c-4134-99e9-eee8a8012753) 00000020:00000080:0.0:1789185421.475713:0:5804:0:(genops.c:1384:class_connect()) connect: client 8ad68fcc-785c-4134-99e9-eee8a8012753, cookie 0x532743011272b66b 00000100:00080000:0.0:1789185421.475726:0:5804:0:(import.c:545:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789185421.475739:0:5804:0:(import.c:666:import_select_connection()) MGC192.168.202.154@tcp: import 00000000b835d625 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:0.0:1789185421.475807:0:5804:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b5c62661 x1876096821756032/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185421.475839:0:5804:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8ad68fcc-785c-4134-99e9-eee8a8012753->MGS 00000020:01000004:0.0:1789185421.475857:0:5804:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789185421.475864:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789185421.475886:0:5804:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000ceec602a) 00000020:00000080:0.0:1789185421.475900:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789185421.479679:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5c62661 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8ad68fcc-785c-4134-99e9-eee8a8012753:3277:1876096821756032:0@lo:250: 00000100:00100000:1.0:1789185421.479800:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185421.479882:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821756032 00000100:00100000:1.0:1789185421.479891:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821756032 00000100:00100000:1.0:1789185421.479934:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185421.479941:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005f0399b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1876096821756032:12345-0@lo:250: 00010000:00080000:1.0:1789185421.479972:0:5815:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 8ad68fcc-785c-4134-99e9-eee8a8012753@0@lo t0 exp 0000000000000000 cur 118 last 0 00000020:00000080:1.0:1789185421.480006:0:5815:0:(genops.c:1384:class_connect()) connect: client 8ad68fcc-785c-4134-99e9-eee8a8012753, cookie 0x532743011272b679 00000100:00080000:1.0:1789185421.480149:0:5815:0:(import.c:65:import_set_state_nolock()) 00000000d1e7eb32 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185421.480200:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005f0399b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+5:3277:x1876096821756032:12345-0@lo:250: Request processed in 258us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185421.480208:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185421.480251:0:3277:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789185421.480268:0:3277:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.154@tcp: connect to target with instance 0 00000100:00080000:1.0:1789185421.480276:0:3277:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789185421.480281:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789185421.480284:0:3277:0:(import.c:65:import_set_state_nolock()) 00000000b835d625 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789185421.480287:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789185421.480295:0:3277:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789185421.480299:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5c62661 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8ad68fcc-785c-4134-99e9-eee8a8012753:3277:1876096821756032:0@lo:250: 00000100:00100000:0.0:1789185421.495852:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185421.496065:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789185421.496071:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789185421.498585:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789185421.498600:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789185421.499002:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789185421.499009:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789185421.499691:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185421.499884:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789185421.499890:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789185421.500632:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789185421.500640:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789185421.545976:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789185421.546724:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789185421.546732:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789185421.551115:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789185421.551140:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789185421.553271:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185421.553827:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789185421.553833:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789185421.554807:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789185421.554817:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789185421.555897:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185421.556072:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789185421.556078:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789185421.557061:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789185421.557071:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789185421.558304:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185421.558679:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789185421.558685:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789185421.560113:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789185421.560125:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789185421.598866:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185421.599074:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789185421.599081:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789185421.601036:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789185421.601051:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789185421.602246:0:5804:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789185421.602257:0:5804:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789185421.603059:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789185421.603078:0:5804:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789185421.603084:0:5804:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789185421.603189:0:5804:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789185421.603229:0:5804:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.154@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789185421.603232:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789185421.603233:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789185421.603234:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789185421.603235:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789185421.603236:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789185421.603237:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789185421.603238:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789185421.603238:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789185421.603239:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789185421.603240:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789185421.603241:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789185421.603242:0:5804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789185421.603244:0:5804:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789185421.603245:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789185421.603246:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789185421.603250:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789185421.603250:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789185421.603251:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789185421.603251:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789185421.603252:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789185421.603252:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789185421.603253:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789185421.603253:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789185421.603254:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789185421.603254:0:5804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789185421.603559:0:5804:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789185421.603574:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002b4c4db3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821756160:0@lo:253: 00000100:00100000:2.0:1789185421.603631:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185421.603668:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821756160 00000100:00100000:1.0:1789185421.603675:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821756160 00000100:00100000:2.0:1789185421.603682:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a450fc7 going to sleep for 11 seconds 00000100:00100000:1.0:1789185421.603717:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789185421.603726:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f8d709b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+5:5804:x1876096821756160:12345-0@lo:253: 20000000:01000000:1.0:1789185421.603765:0:5817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789185421.603769:0:5817:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789185421.604169:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789185421.604191:0:5817:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1789185421.604659:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789185421.605302:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789185421.605765:0:5817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789185421.605768:0:5817:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789185421.605773:0:5817:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789185421.605776:0:5817:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789185421.605792:0:5817:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789185421.605926:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185421.606103:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789185421.606114:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789185421.606150:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789185421.606177:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789185421.606197:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789185421.606371:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789185421.606382:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789185421.606505:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789185421.606514:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789185421.606549:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789185421.606556:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789185421.606587:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789185421.606629:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789185421.606656:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789185421.606668:0:5817:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789185421.606679:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185421.606926:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789185421.606937:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789185421.606983:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789185421.607005:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789185421.607031:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789185421.607039:0:5817:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789185421.607084:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789185421.607089:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789185421.607113:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789185421.607132:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789185421.607148:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789185421.607155:0:5817:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789185421.607199:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789185421.607205:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789185421.607330:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789185421.607351:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789185421.607641:0:5817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789185421.607673:0:5817:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789185421.607679:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789185421.608006:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789185421.608201:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789185421.608218:0:5817:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.154@tcp for mdt 20000000:01000000:2.0:1789185421.608219:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.154@tcp (null) (null) (null) 00000040:00080000:2.0:1789185421.608237:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789185421.608241:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789185421.608256:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789185421.608321:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.154@tcp (null) (null) 00000040:00080000:2.0:1789185421.608355:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789185421.608363:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789185421.608379:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789185421.608590:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789185421.608637:0:5817:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789185421.608639:0:5817:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789185421.608644:0:5817:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789185421.608649:0:5817:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789185421.608948:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1789185421.609056:0:5817:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789185421.613156:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789185421.613196:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1789185421.613359:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1789185421.613378:0:5817:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789185421.613380:0:5817:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789185421.613383:0:5817:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789185421.613395:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789185421.613397:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789185421.613523:0:5817:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789185421.613526:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789185421.613992:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1789185421.614152:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1789185421.614196:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1789185421.614255:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1789185421.614271:0:5817:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789185421.614272:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789185421.614680:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789185421.614827:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789185421.614856:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789185421.614874:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1789185421.614882:0:5817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789185421.614884:0:5817:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1789185421.614890:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789185421.614907:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000014708ca6/0x532743011272b680 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185421.614924:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000014708ca6/0x532743011272b680 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185421.614935:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000014708ca6/0x532743011272b680 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185421.614951:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000014708ca6/0x532743011272b680 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185421.614957:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000014708ca6/0x532743011272b680 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185421.614964:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000014708ca6/0x532743011272b680 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185421.614970:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000014708ca6 already unused, calling callback (0000000068533787) 00010000:00010000:2.0:1789185421.614973:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000014708ca6/0x532743011272b680 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185421.614981:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000014708ca6/0x532743011272b680 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185421.614991:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000014708ca6/0x532743011272b680 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185421.614995:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000014708ca6/0x532743011272b680 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185421.614999:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000014708ca6/0x532743011272b680 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789185421.615011:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789185421.933356:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f8d709b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+5:5804:x1876096821756160:12345-0@lo:253: Request processed in 329619us (329712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185421.933376:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789185421.933591:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002b4c4db3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821756160:0@lo:253: 10000000:01000000:2.0:1789185421.933612:0:5804:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789185421.933616:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789185421.933619:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789185421.933641:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185421.933643:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789185421.933644:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185421.933645:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185421.933647:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789185421.933648:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789185421.933649:0:5804:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789185421.933651:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185421.933652:0:5804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789185421.933675:0:5804:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007655112a from lustre-MDT0000 10000000:01000000:2.0:1789185421.933707:0:5804:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789185421.933710:0:5804:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789185421.933715:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c7907233380 10000000:01000000:2.0:1789185421.933720:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789185421.933730:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c7907233380 from 1 10000000:01000000:2.0:1789185421.933734:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789185421.933795:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 0000000014708ca6/0x532743011272b687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185421.933807:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 0000000014708ca6/0x532743011272b687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185421.933818:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 0000000014708ca6/0x532743011272b687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185421.933842:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003bb5c5f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821756288:0@lo:101: 00000100:00100000:2.0:1789185421.933882:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185421.933957:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036e7ae95 going to sleep for 11 seconds 00000100:00100000:0.0:1789185421.934191:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821756288 00000100:00100000:0.0:1789185421.934199:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821756288 00000100:00100000:0.0:1789185421.934246:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789185421.934255:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000229e8378 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+5:5804:x1876096821756288:12345-0@lo:101: 00010000:00010000:0.0:1789185421.934268:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185421.934280:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000351503e7/0x532743011272b68e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b687 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185421.934302:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000351503e7/0x532743011272b68e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b687 expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185421.934313:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000351503e7/0x532743011272b68e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b687 expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185421.934322:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000351503e7, rc 0) 00000100:00100000:0.0:1789185421.934367:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000229e8378 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+6:5804:x1876096821756288:12345-0@lo:101: Request processed in 114us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185421.934374:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789185421.934472:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003bb5c5f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821756288:0@lo:101: 00010000:00010000:1.0:1789185421.934485:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 0000000014708ca6/0x532743011272b687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b68e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185421.934494:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 0000000014708ca6/0x532743011272b687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b68e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185421.934555:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6d6cbf7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821756416:0@lo:501: 00000100:00100000:1.0:1789185421.934581:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185421.934610:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db5592bd going to sleep for 11 seconds 00000100:00100000:0.0:1789185421.934667:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821756416 00000100:00100000:0.0:1789185421.934672:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821756416 00000100:00100000:0.0:1789185421.934703:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789185421.934716:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000012da08f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+6:5804:x1876096821756416:12345-0@lo:501: 00000100:00100000:0.0:1789185421.934973:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000012da08f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+6:5804:x1876096821756416:12345-0@lo:501: Request processed in 257us (390us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789185421.934980:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185421.935184:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6d6cbf7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821756416:0@lo:501: 10000000:01000000:3.0:1789185421.935212:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789185421.935234:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 0000000014708ca6/0x532743011272b687 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b68e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185421.935243:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 0000000014708ca6/0x532743011272b687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b68e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185421.935252:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c79102db000 10000000:01000000:3.0:1789185421.935257:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789185421.935261:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c79102db000 10000000:01000000:3.0:1789185421.935263:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789185421.935266:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c79102db000 from 1 10000000:01000000:3.0:1789185421.935269:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789185421.935302:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 00000000f0b05002/0x532743011272b695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185421.935314:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 00000000f0b05002/0x532743011272b695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185421.935323:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 00000000f0b05002/0x532743011272b695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185421.935336:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821756544:0@lo:101: 00000100:00100000:3.0:1789185421.935386:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185421.935454:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cce064e7 going to sleep for 11 seconds 00000100:00100000:1.0:1789185421.935562:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821756544 00000100:00100000:1.0:1789185421.935567:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821756544 00000100:00100000:1.0:1789185421.935602:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789185421.935608:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dab00f3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+6:5804:x1876096821756544:12345-0@lo:101: 00010000:00010000:1.0:1789185421.935617:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185421.935628:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002081d012/0x532743011272b69c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b695 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185421.935643:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002081d012/0x532743011272b69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b695 expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185421.935658:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002081d012/0x532743011272b69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b695 expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185421.935665:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002081d012, rc 0) 00000100:00100000:1.0:1789185421.935692:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dab00f3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+7:5804:x1876096821756544:12345-0@lo:101: Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185421.935697:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789185421.936140:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821756544:0@lo:101: 00010000:00010000:3.0:1789185421.936155:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 00000000f0b05002/0x532743011272b695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b69c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185421.936162:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 00000000f0b05002/0x532743011272b695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b69c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185421.936174:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789185421.936188:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 00000000f0b05002/0x532743011272b695 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b69c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185421.936196:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 00000000f0b05002/0x532743011272b695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b69c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185421.936202:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789185421.936206:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789185421.936210:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c79102db000 10000000:01000000:3.0:1789185421.936212:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789185421.936215:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789185421.936223:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789185421.936240:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 000000004ac20f1e/0x532743011272b6a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185421.936246:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 000000004ac20f1e/0x532743011272b6a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185421.936252:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 000000004ac20f1e/0x532743011272b6a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185421.936263:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821756672:0@lo:101: 00000100:00100000:3.0:1789185421.936290:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185421.936311:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cce064e7 going to sleep for 11 seconds 00000100:00100000:1.0:1789185421.936563:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821756672 00000100:00100000:1.0:1789185421.936569:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821756672 00000100:00100000:1.0:1789185421.936604:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185421.936610:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000051f6e4e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+7:5804:x1876096821756672:12345-0@lo:101: 00010000:00010000:1.0:1789185421.936620:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185421.936628:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000846fb101/0x532743011272b6aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b6a3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185421.936643:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000846fb101/0x532743011272b6aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b6a3 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185421.936651:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000846fb101/0x532743011272b6aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b6a3 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185421.936658:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000846fb101, rc 0) 00000100:00100000:1.0:1789185421.936695:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000051f6e4e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+8:5804:x1876096821756672:12345-0@lo:101: Request processed in 85us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185421.936701:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789185421.937189:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821756672:0@lo:101: 00010000:00010000:3.0:1789185421.937204:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 000000004ac20f1e/0x532743011272b6a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b6aa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185421.937213:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 000000004ac20f1e/0x532743011272b6a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b6aa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185421.937283:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821756800:0@lo:501: 00000100:00100000:3.0:1789185421.937313:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185421.937371:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cce064e7 going to sleep for 11 seconds 00000100:00100000:1.0:1789185421.937575:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821756800 00000100:00100000:1.0:1789185421.937581:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821756800 00000100:00100000:1.0:1789185421.937615:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789185421.937629:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000622456d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+8:5804:x1876096821756800:12345-0@lo:501: 00000100:00100000:1.0:1789185421.937906:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000622456d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+9:5804:x1876096821756800:12345-0@lo:501: Request processed in 277us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185421.937914:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789185421.938178:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821756800:0@lo:501: 00000100:00100000:3.0:1789185421.938214:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821756928:0@lo:503: 00000100:00100000:3.0:1789185421.938257:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185421.938286:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cce064e7 going to sleep for 11 seconds 00000100:00100000:2.0:1789185421.938360:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821756928 00000100:00100000:2.0:1789185421.938365:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821756928 00000100:00100000:2.0:1789185421.938442:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789185421.938451:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eadc8f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+9:5804:x1876096821756928:12345-0@lo:503: 00000100:00100000:2.0:1789185421.938616:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eadc8f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+9:5804:x1876096821756928:12345-0@lo:503: Request processed in 167us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185421.938627:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789185421.938738:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821756928:0@lo:503: 00000100:00100000:3.0:1789185421.939118:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:5845:1876096821757056:0@lo:502: 00000100:00100000:3.0:1789185421.939151:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185421.939178:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e644c034 going to sleep for 11 seconds 00000100:00100000:0.0:1789185421.939389:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821757056 00000100:00100000:0.0:1789185421.939395:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821757056 00000100:00100000:0.0:1789185421.939457:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789185421.939464:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000399eb3c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+9:5845:x1876096821757056:12345-0@lo:502: 00000100:00100000:0.0:1789185421.939632:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000399eb3c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+9:5845:x1876096821757056:12345-0@lo:502: Request processed in 169us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185421.939639:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789185421.940350:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:5845:1876096821757056:0@lo:502: 00000020:01000000:3.0:1789185421.940383:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185421.940397:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185421.940400:0:5845:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789185421.940440:0:5845:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789185421.940444:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789185421.940475:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ea99adfe) 00000020:00000080:3.0:1789185421.940494:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789185421.940500:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789185421.940647:0:5845:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789185421.940654:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x532743011272b6b8 00000020:00000080:3.0:1789185421.941026:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789185421.941030:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185421.941033:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185421.941105:0:5845:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789185421.941109:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185421.941113:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185421.941115:0:5845:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789185421.941118:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789185421.941124:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001f550476) 00000020:00000080:3.0:1789185421.941135:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789185421.941138:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789185421.941139:0:5845:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789185421.941142:0:5845:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789185421.941148:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789185421.941191:0:5845:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007655112a from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789185421.941202:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000535d8c48) 00000020:00000080:3.0:1789185421.941220:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789185421.941276:0:5845:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789185421.941282:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x532743011272b6cd 00000020:00000080:3.0:1789185421.941366:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789185421.941372:0:5845:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789185421.941376:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x532743011272b6d4 00080000:01000000:3.0:1789185421.941380:0:5845:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789185421.941383:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x532743011272b6db 00080000:10000000:3.0:1789185421.941903:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789185421.942090:0:5845:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789185421.949744:0:5845:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789185422.067237:0:5845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789185422.067632:0:5845:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789185422.069897:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789185422.070212:0:5845:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789185422.103160:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e69df1aa) 00000020:00000080:2.0:1789185422.103185:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789185422.103273:0:5845:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789185422.103282:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x532743011272b6e9 00000020:00000080:2.0:1789185422.110023:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789185422.111517:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789185422.152236:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789185422.188497:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789185422.235665:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789185422.278773:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789185422.322351:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1789185422.383550:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x532743011272b6f0 00000020:00000080:1.0:1789185422.384491:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789185422.384507:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185422.384516:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185422.384519:0:5845:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789185422.384522:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185422.384528:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185422.384529:0:5845:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789185422.384532:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789185422.384574:0:5845:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789185422.384590:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185422.384592:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185422.384594:0:5845:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789185422.384596:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185422.384599:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185422.384600:0:5845:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789185422.384603:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789185422.384604:0:5845:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789185422.386653:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000048582a1f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:5845:1876096821757184:0@lo:502: 00000100:00100000:0.0:1789185422.386829:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185422.387013:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 0000000089025ca7 going to sleep for 11 seconds 00000100:00100000:1.0:1789185422.387261:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821757184 00000100:00100000:1.0:1789185422.387271:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821757184 00000100:00100000:1.0:1789185422.387367:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789185422.387378:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000656db1bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+9:5845:x1876096821757184:12345-0@lo:502: 00000100:00100000:1.0:1789185422.387792:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000656db1bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+9:5845:x1876096821757184:12345-0@lo:502: Request processed in 416us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185422.387801:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789185422.387905:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000048582a1f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:5845:1876096821757184:0@lo:502: 00000020:01000000:2.0:1789185422.387940:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185422.387947:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185422.387949:0:5845:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789185422.387954:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789185422.388450:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789185422.388472:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789185422.388490:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 000000004ac20f1e/0x532743011272b6a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b6aa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.388500:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 000000004ac20f1e/0x532743011272b6a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b6aa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185422.388509:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c79102db000 from 1 10000000:01000000:3.0:1789185422.388512:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789185422.388542:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 0000000017c6c2d6/0x532743011272b6f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.388550:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 0000000017c6c2d6/0x532743011272b6f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.388559:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 0000000017c6c2d6/0x532743011272b6f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185422.388575:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821757312:0@lo:101: 00000100:00100000:3.0:1789185422.388611:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185422.388970:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f78f611f going to sleep for 11 seconds 00000100:00100000:0.0:1789185422.389299:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821757312 00000100:00100000:0.0:1789185422.389306:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821757312 00000100:00100000:0.0:1789185422.389337:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789185422.389344:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000098e0406f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+9:5804:x1876096821757312:12345-0@lo:101: 00010000:00010000:0.0:1789185422.389357:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185422.389374:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000021f8457e/0x532743011272b6fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b6f7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185422.389422:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000021f8457e/0x532743011272b6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b6f7 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185422.389446:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000021f8457e/0x532743011272b6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b6f7 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185422.389455:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000021f8457e, rc 0) 00000100:00100000:0.0:1789185422.389501:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000098e0406f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+10:5804:x1876096821757312:12345-0@lo:101: Request processed in 158us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185422.389508:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185422.389686:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821757312:0@lo:101: 00010000:00010000:3.0:1789185422.389710:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 0000000017c6c2d6/0x532743011272b6f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b6fe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.389719:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 0000000017c6c2d6/0x532743011272b6f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b6fe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185422.390815:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821757440:0@lo:256: 00000100:00100000:3.0:1789185422.390925:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185422.390968:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f78f611f going to sleep for 11 seconds 00000100:00100000:0.0:1789185422.391061:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821757440 00000100:00100000:0.0:1789185422.391067:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821757440 00000100:00100000:0.0:1789185422.391111:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789185422.391119:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000991ceb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+10:5804:x1876096821757440:12345-0@lo:256: 20000000:01000000:0.0:1789185422.391137:0:5817:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789185422.391142:0:5817:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789185422.391224:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000991ceb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+10:5804:x1876096821757440:12345-0@lo:256: Request processed in 107us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185422.391231:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185422.391445:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821757440:0@lo:256: 10000000:01000000:3.0:1789185422.392531:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789185422.392565:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 0000000017c6c2d6/0x532743011272b6f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b6fe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.392578:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 0000000017c6c2d6/0x532743011272b6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b6fe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185422.392586:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c79102db000 from 1 10000000:01000000:3.0:1789185422.392588:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185422.392635:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 00000000adc9da2b/0x532743011272b705 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.392642:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 00000000adc9da2b/0x532743011272b705 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.392652:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 00000000adc9da2b/0x532743011272b705 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185422.392686:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821757568:0@lo:101: 00000100:00100000:3.0:1789185422.392736:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185422.392782:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f78f611f going to sleep for 11 seconds 00000100:00100000:1.0:1789185422.392887:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821757568 00000100:00100000:1.0:1789185422.392900:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821757568 00000100:00100000:1.0:1789185422.392957:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789185422.392964:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004669a586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+10:5804:x1876096821757568:12345-0@lo:101: 00010000:00010000:1.0:1789185422.392977:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185422.392989:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000065b284f4/0x532743011272b70c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b705 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.393014:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065b284f4/0x532743011272b70c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b705 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.393023:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000065b284f4/0x532743011272b70c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b705 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.393041:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000065b284f4, rc 0) 00000100:00100000:1.0:1789185422.393088:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004669a586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:5804:x1876096821757568:12345-0@lo:101: Request processed in 124us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185422.393094:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789185422.393138:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0e7f68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821757568:0@lo:101: 00010000:00010000:1.0:1789185422.393151:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 00000000adc9da2b/0x532743011272b705 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b70c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.393159:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 00000000adc9da2b/0x532743011272b705 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b70c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185422.393210:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2d61e2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821757696:0@lo:501: 00000100:00100000:1.0:1789185422.393236:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185422.393249:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000365858d5 going to sleep for 11 seconds 00000100:00100000:1.0:1789185422.393262:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821757696 00000100:00100000:1.0:1789185422.393266:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821757696 00000100:00100000:1.0:1789185422.393288:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789185422.393293:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b05f362e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:5804:x1876096821757696:12345-0@lo:501: 00000100:00100000:1.0:1789185422.393890:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b05f362e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:5804:x1876096821757696:12345-0@lo:501: Request processed in 595us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185422.393898:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789185422.393968:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2d61e2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821757696:0@lo:501: 00000100:00100000:1.0:1789185422.393997:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2d61e2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821757824:0@lo:503: 00000100:00100000:1.0:1789185422.394035:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185422.394054:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000365858d5 going to sleep for 11 seconds 00000100:00100000:1.0:1789185422.394066:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821757824 00000100:00100000:1.0:1789185422.394070:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821757824 00000100:00100000:1.0:1789185422.394088:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185422.394094:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000900f2e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:5804:x1876096821757824:12345-0@lo:503: 00000040:00080000:1.0:1789185422.394128:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789185422.394165:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000900f2e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:5804:x1876096821757824:12345-0@lo:503: Request processed in 71us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185422.394171:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185422.394208:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2d61e2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821757824:0@lo:503: 00000040:00080000:1.0:1789185422.394857:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789185422.394914:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789185422.394931:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789185422.394938:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 00000000adc9da2b/0x532743011272b705 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b70c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.394947:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 00000000adc9da2b/0x532743011272b705 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b70c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185422.395025:0:5804:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789185422.395028:0:5804:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c79102db000 10000000:01000000:1.0:1789185422.395031:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c79102db000 10000000:01000000:1.0:1789185422.395035:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789185422.395039:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c79102db000 from 1 10000000:01000000:1.0:1789185422.395042:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789185422.395065:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 00000000aab4a6e2/0x532743011272b713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.395072:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 00000000aab4a6e2/0x532743011272b713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.395081:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 00000000aab4a6e2/0x532743011272b713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185422.395093:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2d61e2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821757952:0@lo:101: 00000100:00100000:1.0:1789185422.395125:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185422.395150:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a450fc7 going to sleep for 11 seconds 00000100:00100000:1.0:1789185422.395164:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821757952 00000100:00100000:1.0:1789185422.395168:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821757952 00000100:00100000:1.0:1789185422.395188:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185422.395194:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003a928463 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:5804:x1876096821757952:12345-0@lo:101: 00010000:00010000:1.0:1789185422.395202:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185422.395212:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000798f2a15/0x532743011272b71a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b713 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.395230:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000798f2a15/0x532743011272b71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b713 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.395249:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000798f2a15/0x532743011272b71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b713 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.395257:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000798f2a15, rc 0) 00000100:00100000:1.0:1789185422.395288:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003a928463 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5804:x1876096821757952:12345-0@lo:101: Request processed in 95us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185422.395294:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185422.395330:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2d61e2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821757952:0@lo:101: 00010000:00010000:1.0:1789185422.395341:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 00000000aab4a6e2/0x532743011272b713 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b71a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.395349:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 00000000aab4a6e2/0x532743011272b713 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b71a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185422.395385:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2d61e2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821758080:0@lo:501: 00000100:00100000:1.0:1789185422.395442:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185422.395459:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f9fb344 going to sleep for 11 seconds 00000100:00100000:1.0:1789185422.395472:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821758080 00000100:00100000:1.0:1789185422.395475:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821758080 00000100:00100000:1.0:1789185422.395490:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789185422.395495:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004e6426f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5804:x1876096821758080:12345-0@lo:501: 00000100:00100000:1.0:1789185422.395691:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004e6426f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5804:x1876096821758080:12345-0@lo:501: Request processed in 195us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185422.395698:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789185422.395726:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2d61e2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821758080:0@lo:501: 00000100:00100000:1.0:1789185422.395748:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2d61e2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821758208:0@lo:503: 00000100:00100000:1.0:1789185422.395783:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185422.395796:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f9fb344 going to sleep for 11 seconds 00000100:00100000:1.0:1789185422.395808:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821758208 00000100:00100000:1.0:1789185422.395811:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821758208 00000100:00100000:1.0:1789185422.395827:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789185422.395832:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000042c98fa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5804:x1876096821758208:12345-0@lo:503: 00000100:00100000:1.0:1789185422.396124:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000042c98fa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5804:x1876096821758208:12345-0@lo:503: Request processed in 291us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185422.396131:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789185422.396171:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2d61e2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821758208:0@lo:503: 00000100:00100000:2.0:1789185422.397786:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e536fd23 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:5850:1876096821758336:0@lo:502: 00000100:00100000:2.0:1789185422.397860:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185422.398007:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d28d8012 going to sleep for 11 seconds 00000100:00100000:1.0:1789185422.398110:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821758336 00000100:00100000:1.0:1789185422.398118:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821758336 00000100:00100000:1.0:1789185422.398204:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789185422.398214:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000059e80dce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5850:x1876096821758336:12345-0@lo:502: 00000100:00100000:1.0:1789185422.399365:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000059e80dce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5850:x1876096821758336:12345-0@lo:502: Request processed in 1150us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185422.399375:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789185422.400636:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e536fd23 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:5850:1876096821758336:0@lo:502: 00000020:01000004:2.0:1789185422.400735:0:5850:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789185422.400752:0:5850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000004778157c) 00000020:00000080:2.0:1789185422.400773:0:5850:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789185422.400961:0:5850:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007655112a from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789185422.400979:0:5850:0:(tgt_mount.c:187:server_put_mount()) put mount 000000007655112a from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789185422.400982:0:5850:0:(obd_mount.c:710:lustre_put_lsi()) put 000000007655112a 4 00010000:00080000:2.0:1789185422.401012:0:5850:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000056ca1b4f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1789185422.404793:0:5850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789185422.405485:0:5850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789185422.405543:0:5850:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789185422.405557:0:5850:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x532743011272b728 00000100:00080000:3.0:1789185422.405570:0:5850:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789185422.405582:0:5850:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000056ca1b4f using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789185422.405624:0:5850:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000714d6ec3 x1876096821758464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789185422.405687:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000714d6ec3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876096821758464:0@lo:38: 00000100:00100000:1.0:1789185422.405772:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185422.405897:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821758464 00000100:00100000:2.0:1789185422.405906:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821758464 00000100:00100000:2.0:1789185422.405944:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185422.405950:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d61e2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1876096821758464:12345-0@lo:38: 00000100:00080000:3.0:1789185422.406008:0:5850:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789185422.408583:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d61e2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1876096821758464:12345-0@lo:38: Request processed in 2625us (2804us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789185422.408599:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185422.410570:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789185422.410583:0:3277:0:(import.c:65:import_set_state_nolock()) 0000000056ca1b4f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789185422.410591:0:3277:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789185422.410595:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000714d6ec3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876096821758464:0@lo:38: 00000100:00100000:2.0:1789185422.411240:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e536fd23 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:5850:1876096821758592:0@lo:502: 00000100:00100000:2.0:1789185422.411316:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185422.411391:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d28d8012 going to sleep for 11 seconds 00000100:00100000:1.0:1789185422.411480:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821758592 00000100:00100000:1.0:1789185422.411487:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821758592 00000100:00100000:1.0:1789185422.411531:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789185422.411546:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003f99b072 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5850:x1876096821758592:12345-0@lo:502: 00000100:00100000:1.0:1789185422.412200:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003f99b072 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5850:x1876096821758592:12345-0@lo:502: Request processed in 653us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185422.412209:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789185422.412282:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e536fd23 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:5850:1876096821758592:0@lo:502: 00000040:00080000:2.0:1789185422.412310:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1789185422.412510:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789185422.412534:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789185422.412553:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 00000000aab4a6e2/0x532743011272b713 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b71a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.412564:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 00000000aab4a6e2/0x532743011272b713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b71a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789185422.412613:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789185422.412616:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789185422.412617:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789185422.412619:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789185422.412620:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789185422.412622:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789185422.412623:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789185422.412624:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789185422.412626:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789185422.412627:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789185422.412629:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789185422.412630:0:5804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789185422.412634:0:5804:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789185422.412636:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789185422.412638:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789185422.412639:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789185422.412640:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789185422.412641:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789185422.412643:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789185422.412644:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789185422.412644:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789185422.412645:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789185422.412646:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789185422.412651:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789185422.412652:0:5804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789185422.412666:0:5804:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789185422.412675:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003eb480cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821758720:0@lo:253: 00000100:00100000:1.0:1789185422.412949:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185422.412974:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 0000000040037e56 going to sleep for 11 seconds 00000100:00100000:1.0:1789185422.412990:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821758720 00000100:00100000:1.0:1789185422.412994:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821758720 00000100:00100000:1.0:1789185422.413018:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789185422.413024:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000544f91ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5804:x1876096821758720:12345-0@lo:253: 20000000:01000000:1.0:1789185422.413058:0:5817:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789185422.413070:0:5817:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789185422.462070:0:5817:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789185422.462093:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789185422.462240:0:5838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789185422.462246:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789185422.462268:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000003739dfa/0x532743011272b72f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185422.462289:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000021f8457e/0x532743011272b6fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b6f7 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185422.462297:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000003739dfa/0x532743011272b72f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185422.462336:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000021f8457e/0x532743011272b6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b6f7 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185422.462350:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000021f8457e/0x532743011272b6fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b6f7 expref: 12 pid: 5817 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185422.462379:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e536fd23 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1876096821758848:0@lo:104: 00000100:00100000:2.0:1789185422.462486:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185422.462580:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d28d8012 going to sleep for 11 seconds 00000100:00100000:1.0:1789185422.464379:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821758848 00000100:00100000:1.0:1789185422.464393:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821758848 00000100:00100000:1.0:1789185422.464471:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185422.464480:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b238edab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+3:5838:x1876096821758848:12345-0@lo:104: 00010000:00010000:1.0:1789185422.464498:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: 0000000017c6c2d6/0x532743011272b6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b6fe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.464590:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789185422.464596:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b238edab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+3:5838:x1876096821758848:12345-0@lo:104: Request processed in 118us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185422.464603:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789185422.464624:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185422.464629:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: 0000000017c6c2d6/0x532743011272b6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b6fe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.464637:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000017c6c2d6 already unused, calling callback (00000000550da09f) 10000000:00010000:1.0:1789185422.464653:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: 0000000017c6c2d6/0x532743011272b6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b6fe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.464661:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: 0000000017c6c2d6/0x532743011272b6f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b6fe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185422.464668:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: 0000000017c6c2d6/0x532743011272b6f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b6fe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185422.464674:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789185422.464823:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: 0000000017c6c2d6/0x532743011272b6f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b6fe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.464831:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789185422.464855:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: 0000000017c6c2d6/0x532743011272b6f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b6fe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.464862:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: 0000000017c6c2d6/0x532743011272b6f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b6fe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185422.464879:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185422.464881:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185422.464882:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185422.464936:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185422.464948:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e488b28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821758976:0@lo:103: 00000100:00100000:1.0:1789185422.464985:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185422.465497:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821758976 00000100:00100000:3.0:1789185422.465505:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821758976 00010000:00010000:3.0:1789185422.465531:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000021f8457e/0x532743011272b6fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b6f7 expref: 13 pid: 5817 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185422.465565:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789185422.465572:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000027e703ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+13:3278:x1876096821758976:12345-0@lo:103: 00010000:00010000:3.0:1789185422.465584:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185422.465590:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000021f8457e/0x532743011272b6fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b6f7 expref: 13 pid: 5817 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.465600:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000021f8457e/0x532743011272b6fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b6f7 expref: 13 pid: 5817 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.465619:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000003739dfa/0x532743011272b72f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.465636:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000003739dfa/0x532743011272b72f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789185422.465652:0:5808:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003407789s 00010000:00010000:3.0:1789185422.465656:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000003739dfa/0x532743011272b72f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.465662:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000003739dfa/0x532743011272b72f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.465670:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000003739dfa/0x532743011272b72f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.465676:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000003739dfa/0x532743011272b72f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.465682:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000003739dfa already unused, calling callback (0000000068533787) 00010000:00010000:3.0:1789185422.465686:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000003739dfa/0x532743011272b72f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.465702:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000003739dfa/0x532743011272b72f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.465711:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000003739dfa/0x532743011272b72f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.465722:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185422.465765:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000027e703ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+13:3278:x1876096821758976:12345-0@lo:103: Request processed in 193us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185422.465772:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789185422.465834:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000021f8457e/0x532743011272b6fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b6f7 expref: 12 pid: 5817 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185422.465847:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e536fd23 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1876096821758848:0@lo:104: 00010000:00010000:3.0:1789185422.465865:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000003739dfa/0x532743011272b72f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.465873:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000003739dfa/0x532743011272b72f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.465878:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000003739dfa/0x532743011272b72f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185422.465883:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000003739dfa/0x532743011272b72f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185422.466094:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e488b28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821758976:0@lo:103: 00000100:00100000:2.0:1789185422.472725:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000544f91ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:5804:x1876096821758720:12345-0@lo:253: Request processed in 59692us (59768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185422.472742:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789185422.472893:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003eb480cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:5804:1876096821758720:0@lo:253: 10000000:01000000:1.0:1789185422.472910:0:5804:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789185422.472926:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789185422.472928:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789185422.472929:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789185422.472931:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789185422.472932:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789185422.472933:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789185422.472934:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789185422.472936:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789185422.472937:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789185422.472938:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789185422.472940:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789185422.472941:0:5804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789185422.472958:0:5804:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789185422.479470:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789185422.479888:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789185422.480109:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789185422.480282:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789185422.480894:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789185422.481079:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00010000:00010000:3.0:1789185422.482935:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1789185422.483598:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789185422.483794:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789185422.484009:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789185422.484253:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789185422.484530:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789185422.484705:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1789185422.525735:0:5804:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789185422.554556:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789185422.554724:0:5855:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789185422.554729:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789185422.554870:0:5856:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789185422.562509:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789185422.562847:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789185422.563258:0:5804:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789185422.563267:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789185422.563440:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185422.564352:0:5804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789185422.565841:0:5804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789185422.565892:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789185422.570351:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789185422.570630:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1789185422.572815:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789185422.572957:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789185422.574760:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789185422.574991:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789185422.580250:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789185422.580448:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789185422.580591:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789185422.580752:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789185422.580882:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789185422.581035:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789185422.581181:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789185422.581342:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789185422.581513:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789185422.581649:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789185422.581774:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789185422.581928:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789185422.582212:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789185422.582661:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789185422.582803:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789185422.583167:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789185422.583290:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789185422.583632:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789185422.583779:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789185422.583935:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789185422.584146:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789185422.584315:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789185422.584496:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789185422.584670:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789185422.584814:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789185422.584966:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789185422.586665:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789185422.586860:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789185422.587045:0:5804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789185422.594873:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1789185422.640233:0:5804:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789185422.640276:0:5804:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadbe41c6f988 00100000:10000000:1.0:1789185422.640285:0:5804:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789185422.643151:0:5804:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789185422.643171:0:5804:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789185422.643186:0:5804:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1789185422.643221:0:5804:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1789185422.690668:0:5856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789185422.690768:0:5856:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789185422.690773:0:5856:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789185423.507062:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185424.530241:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185425.552611:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185426.576658:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789185427.580846:0:6099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789185427.602104:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789185427.857268:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789185427.857280:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789185427.857300:0:36:0:(import.c:65:import_set_state_nolock()) 0000000056ca1b4f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789185427.857321:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000056ca1b4f using connection 192.168.202.154@tcp/0@lo 00000100:00100000:1.0:1789185427.857358:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006e488b28 x1876096821759232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789185427.857377:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003eb480cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821759104:0@lo:400: 00000100:00100000:1.0:1789185427.857399:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e488b28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876096821759232:0@lo:38: 00000100:00100000:0.0:1789185427.860362:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185427.860475:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821759104 00000100:00100000:2.0:1789185427.860484:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821759104 00000100:00100000:2.0:1789185427.860530:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789185427.860538:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad184105 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+11:3280:x1876096821759104:12345-0@lo:400: 00000100:00100000:2.0:1789185427.860949:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad184105 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+11:3280:x1876096821759104:12345-0@lo:400: Request processed in 411us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185427.860957:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789185427.861042:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003eb480cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821759104:0@lo:400: 00000100:00100000:1.0:1789185427.865393:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185427.865965:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821759232 00000100:00100000:0.0:1789185427.865976:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821759232 00000100:00100000:0.0:1789185427.866045:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789185427.866059:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a352c825 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1876096821759232:12345-0@lo:38: 00010000:00080000:0.0:1789185427.866087:0:5824:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 124 last 0 00000020:00000080:0.0:1789185427.866123:0:5824:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x532743011272b736 00000004:00100000:0.0:1789185427.866175:0:5824:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789185427.866293:0:5824:0:(import.c:65:import_set_state_nolock()) 0000000000b366e0 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185427.866387:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a352c825 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876096821759232:12345-0@lo:38: Request processed in 328us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185427.866395:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789185427.866498:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006e488b28 x1876096821759232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789185427.866515:0:3277:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789185427.866523:0:3277:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789185427.866527:0:3277:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789185427.866529:0:3277:0:(import.c:65:import_set_state_nolock()) 0000000056ca1b4f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789185427.866536:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e488b28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876096821759232:0@lo:38: 00010000:00010000:2.0:1789185428.638630:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185429.647842:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185430.681358:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789185430.928263:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789185430.928270:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c79102db000 from 3 10000000:01000000:0.0:1789185430.928276:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789185430.928342:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 000000005f47ad6d/0x532743011272b73d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185430.928356:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 000000005f47ad6d/0x532743011272b73d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185430.928369:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 000000005f47ad6d/0x532743011272b73d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185430.928396:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b321bac2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821759360:0@lo:101: 00000100:00100000:0.0:1789185430.930430:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185430.934219:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ced2b726 going to sleep for 11 seconds 00000100:00100000:2.0:1789185430.935261:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821759360 00000100:00100000:2.0:1789185430.935276:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821759360 00000100:00100000:2.0:1789185430.935371:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789185430.935381:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007615f621 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:5820:x1876096821759360:12345-0@lo:101: 00010000:00010000:2.0:1789185430.935399:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185430.935452:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b09b3670/0x532743011272b744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b73d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185430.935482:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b09b3670/0x532743011272b744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b73d expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185430.935493:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b09b3670/0x532743011272b744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b73d expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185430.935501:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b09b3670, rc 0) 00000100:00100000:2.0:1789185430.935746:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007615f621 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5820:x1876096821759360:12345-0@lo:101: Request processed in 367us (5345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185430.935754:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789185430.936171:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b321bac2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821759360:0@lo:101: 00010000:00010000:0.0:1789185430.936190:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 000000005f47ad6d/0x532743011272b73d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b744 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185430.936199:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 000000005f47ad6d/0x532743011272b73d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b744 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185430.936270:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b321bac2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821759488:0@lo:256: 00000100:00100000:0.0:1789185430.936309:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185430.936355:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ced2b726 going to sleep for 11 seconds 00000100:00100000:3.0:1789185430.936768:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821759488 00000100:00100000:3.0:1789185430.936786:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821759488 00000100:00100000:3.0:1789185430.936840:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789185430.936847:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000005c9638a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5820:x1876096821759488:12345-0@lo:256: 20000000:01000000:3.0:1789185430.936863:0:5816:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789185430.936880:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789185430.936883:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789185430.936967:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000005c9638a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5820:x1876096821759488:12345-0@lo:256: Request processed in 120us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185430.937111:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789185430.937156:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b321bac2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821759488:0@lo:256: 10000000:01000000:3.0:1789185430.937204:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789185430.937216:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 000000005f47ad6d/0x532743011272b73d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b744 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185430.937225:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 000000005f47ad6d/0x532743011272b73d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b744 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185431.713557:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185432.721373:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789185432.950396:0:6301:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9d07f1a0 20000000:00000080:3.0:1789185432.950899:0:6301:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c7936df3800 uarg=0000000000000000 20000000:01000000:3.0:1789185432.951022:0:6301:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789185432.951030:0:6301:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789185432.951037:0:6301:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789185432.952353:0:6301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789185432.952371:0:6301:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789185432.959034:0:6301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789185432.959290:0:6301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789185432.959365:0:6301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789185432.959451:0:6301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789185432.959470:0:6301:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789185432.959488:0:6301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c822abae/0x532743011272b74b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185432.959507:0:6301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000065b284f4/0x532743011272b70c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b705 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185432.959514:0:6301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c822abae/0x532743011272b74b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185432.959552:0:6301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000065b284f4/0x532743011272b70c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b705 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185432.959566:0:6301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000065b284f4/0x532743011272b70c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b705 expref: 11 pid: 5817 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185432.959596:0:6301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000819601ce pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6301:1876096821759616:0@lo:104: 00000100:00100000:3.0:1789185432.959658:0:6301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185432.959708:0:6301:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb8dabb2 going to sleep for 11 seconds 00000100:00100000:0.0:1789185432.960175:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821759616 00000100:00100000:0.0:1789185432.960184:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821759616 00000100:00100000:0.0:1789185432.960228:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789185432.960236:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000900ffaaa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:6301:x1876096821759616:12345-0@lo:104: 00010000:00010000:0.0:1789185432.960247:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: 00000000adc9da2b/0x532743011272b705 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b70c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185432.960326:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789185432.960331:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000900ffaaa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:6301:x1876096821759616:12345-0@lo:104: Request processed in 97us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185432.960337:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789185432.960398:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185432.960434:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: 00000000adc9da2b/0x532743011272b705 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b70c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960442:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000adc9da2b already unused, calling callback (00000000550da09f) 10000000:00010000:2.0:1789185432.960445:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: 00000000adc9da2b/0x532743011272b705 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b70c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960453:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: 00000000adc9da2b/0x532743011272b705 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b70c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185432.960460:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: 00000000adc9da2b/0x532743011272b705 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b70c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185432.960477:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789185432.960507:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: 00000000adc9da2b/0x532743011272b705 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b70c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960513:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185432.960532:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: 00000000adc9da2b/0x532743011272b705 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b70c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960537:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: 00000000adc9da2b/0x532743011272b705 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b70c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960555:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185432.960557:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185432.960558:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185432.960570:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8b540e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821759744:0@lo:103: 00000100:00100000:2.0:1789185432.960602:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185432.960648:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821759744 00000100:00100000:2.0:1789185432.960652:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821759744 00010000:00010000:2.0:1789185432.960670:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000065b284f4/0x532743011272b70c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b705 expref: 12 pid: 5817 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185432.960691:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789185432.960697:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005eb70533 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:3281:x1876096821759744:12345-0@lo:103: 00010000:00010000:2.0:1789185432.960707:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185432.960711:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000065b284f4/0x532743011272b70c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b705 expref: 12 pid: 5817 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960720:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000065b284f4/0x532743011272b70c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b705 expref: 12 pid: 5817 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960742:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c822abae/0x532743011272b74b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960749:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c822abae/0x532743011272b74b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960762:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c822abae/0x532743011272b74b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960768:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c822abae/0x532743011272b74b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960774:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c822abae/0x532743011272b74b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960780:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c822abae/0x532743011272b74b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960784:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c822abae already unused, calling callback (0000000068533787) 00010000:00010000:2.0:1789185432.960787:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c822abae/0x532743011272b74b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960793:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c822abae/0x532743011272b74b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960799:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c822abae/0x532743011272b74b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185432.960807:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185432.960834:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005eb70533 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:3281:x1876096821759744:12345-0@lo:103: Request processed in 138us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185432.960850:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789185432.960882:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8b540e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821759744:0@lo:103: 00010000:00010000:3.0:1789185432.962088:0:6301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000065b284f4/0x532743011272b70c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b705 expref: 11 pid: 5817 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185432.962108:0:6301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000819601ce pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6301:1876096821759616:0@lo:104: 00010000:00010000:3.0:1789185432.962136:0:6301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c822abae/0x532743011272b74b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185432.962146:0:6301:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c822abae/0x532743011272b74b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185432.962151:0:6301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c822abae/0x532743011272b74b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185432.962157:0:6301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c822abae/0x532743011272b74b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185432.984784:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5e80322 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821760000:0@lo:400: 00000100:00100000:2.0:1789185432.984860:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185432.984924:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185432.984931:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8b540e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821759872:0@lo:400: 00000100:00100000:2.0:1789185432.985092:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185432.985195:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821760000 00000100:00100000:2.0:1789185432.985205:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821760000 00000100:00100000:2.0:1789185432.985268:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185432.985278:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002180b32a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821760000:12345-0@lo:400: 00000100:00100000:2.0:1789185432.985349:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002180b32a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821760000:12345-0@lo:400: Request processed in 72us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185432.985358:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185432.985386:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821759872 00000100:00100000:2.0:1789185432.985389:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821759872 00000100:00100000:2.0:1789185432.985445:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789185432.985452:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003f1b5a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+11:3279:x1876096821759872:12345-0@lo:400: 00000100:00100000:2.0:1789185432.985482:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003f1b5a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+11:3279:x1876096821759872:12345-0@lo:400: Request processed in 33us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185432.985488:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789185432.985532:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8b540e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821759872:0@lo:400: 00010000:00080000:2.0:1789185432.985547:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d5e80322 x1876096821760000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185432.985560:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5e80322 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821760000:0@lo:400: 00010000:00010000:2.0:1789185433.744030:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185434.767722:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185435.795699:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789185436.242629:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789185436.242635:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c79102db000 from 1 10000000:01000000:3.0:1789185436.242641:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185436.242686:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 0000000044ad967d/0x532743011272b752 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185436.242701:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 0000000044ad967d/0x532743011272b752 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185436.242712:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 0000000044ad967d/0x532743011272b752 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185436.242754:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000819601ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821760128:0@lo:101: 00000100:00100000:3.0:1789185436.242821:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185436.244423:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000008646c363 going to sleep for 11 seconds 00000100:00100000:3.0:1789185436.244457:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821760128 00000100:00100000:3.0:1789185436.244465:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821760128 00000100:00100000:3.0:1789185436.244518:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789185436.244526:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b89d8bc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:5820:x1876096821760128:12345-0@lo:101: 00010000:00010000:3.0:1789185436.244543:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185436.244560:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c822abae/0x532743011272b759 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b752 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185436.244586:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c822abae/0x532743011272b759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b752 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185436.244599:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c822abae/0x532743011272b759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b752 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185436.244608:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c822abae, rc 0) 00000100:00100000:3.0:1789185436.244676:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b89d8bc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5820:x1876096821760128:12345-0@lo:101: Request processed in 150us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185436.244683:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789185436.244737:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000819601ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821760128:0@lo:101: 00010000:00010000:3.0:1789185436.244754:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 0000000044ad967d/0x532743011272b752 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b759 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185436.244762:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 0000000044ad967d/0x532743011272b752 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b759 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185436.244847:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000819601ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821760256:0@lo:501: 00000100:00100000:3.0:1789185436.244877:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185436.244894:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000008646c363 going to sleep for 11 seconds 00000100:00100000:1.0:1789185436.247196:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821760256 00000100:00100000:1.0:1789185436.247208:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821760256 00000100:00100000:1.0:1789185436.247267:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789185436.247285:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000047e717b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5820:x1876096821760256:12345-0@lo:501: 00000100:00100000:1.0:1789185436.247558:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000047e717b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5820:x1876096821760256:12345-0@lo:501: Request processed in 274us (2680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185436.247566:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789185436.247683:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000819601ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821760256:0@lo:501: 00000100:00100000:3.0:1789185436.247734:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000819601ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821760384:0@lo:503: 00000100:00100000:3.0:1789185436.247779:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185436.247809:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000008646c363 going to sleep for 11 seconds 00000100:00100000:3.0:1789185436.247823:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821760384 00000100:00100000:3.0:1789185436.247827:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821760384 00000100:00100000:3.0:1789185436.247857:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185436.247863:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f71790f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5820:x1876096821760384:12345-0@lo:503: 00000100:00100000:3.0:1789185436.248082:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f71790f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5820:x1876096821760384:12345-0@lo:503: Request processed in 219us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185436.248089:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185436.248125:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000819601ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821760384:0@lo:503: 00000100:00100000:3.0:1789185436.249582:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000819601ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:6513:1876096821760512:0@lo:502: 00000100:00100000:3.0:1789185436.249641:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185436.249681:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000008646c363 going to sleep for 11 seconds 00000100:00100000:0.0:1789185436.249736:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821760512 00000100:00100000:0.0:1789185436.249743:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821760512 00000100:00100000:0.0:1789185436.249996:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789185436.250006:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000075b7b860 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6513:x1876096821760512:12345-0@lo:502: 00000100:00100000:0.0:1789185436.250203:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000075b7b860 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6513:x1876096821760512:12345-0@lo:502: Request processed in 199us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185436.250211:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789185436.250395:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000819601ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:6513:1876096821760512:0@lo:502: 00000020:01000000:1.0:1789185436.250456:0:6513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185436.250465:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185436.250468:0:6513:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789185436.250476:0:6513:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c79102db000 00000020:00000080:1.0:1789185436.250478:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789185436.250521:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:6513:1876096821760640:0@lo:502: 00000100:00100000:1.0:1789185436.250559:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185436.250756:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821760640 00000100:00100000:3.0:1789185436.250762:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821760640 00000100:00100000:3.0:1789185436.250787:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789185436.250794:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6513:x1876096821760640:12345-0@lo:502: 00000100:00100000:3.0:1789185436.250998:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6513:x1876096821760640:12345-0@lo:502: Request processed in 203us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185436.251014:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789185436.251332:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905310540 going to sleep for 11 seconds 00000100:00100000:1.0:1789185436.251349:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:6513:1876096821760640:0@lo:502: 00000020:01000000:1.0:1789185436.251368:0:6513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185436.251372:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185436.251374:0:6513:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789185436.251378:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789185436.251575:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789185436.251593:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185436.251602:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901521e00/0x532743011272b752 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b759 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185436.251614:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7901521e00/0x532743011272b752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b759 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185436.815892:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185437.842980:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185438.098562:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821760896:0@lo:400: 00000100:00100000:2.0:1789185438.098664:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185438.098741:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185438.098747:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821760768:0@lo:400: 00000100:00100000:2.0:1789185438.098781:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185438.098819:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821760896 00000100:00100000:2.0:1789185438.098830:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821760896 00000100:00100000:2.0:1789185438.098889:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789185438.098899:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821760896:12345-0@lo:400: 00000100:00100000:2.0:1789185438.098974:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821760896:12345-0@lo:400: Request processed in 75us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185438.098982:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789185438.099036:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7936db8700 x1876096821760896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185438.099055:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821760896:0@lo:400: 00000100:00100000:3.0:1789185438.099383:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821760768 00000100:00100000:3.0:1789185438.099389:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821760768 00000100:00100000:3.0:1789185438.099458:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185438.099467:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:3281:x1876096821760768:12345-0@lo:400: 00000100:00100000:3.0:1789185438.099518:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:3281:x1876096821760768:12345-0@lo:400: Request processed in 53us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185438.099525:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185438.099561:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821760768:0@lo:400: 00010000:00010000:2.0:1789185438.863879:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185439.887629:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789185440.310927:0:6674:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789185440.310932:0:6674:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789185440.311085:0:6674:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c791f9b0000 00000020:01000004:2.0:1789185440.311102:0:6674:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789185440.311115:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789185440.311140:0:6674:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c792f803380) 00000020:00000080:2.0:1789185440.311163:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789185440.326994:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789185440.327510:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789185440.356626:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789185440.363095:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789185440.363136:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789185440.363202:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789185440.363243:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789185440.363814:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789185440.363827:0:6674:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789185440.363838:0:6674:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x532743011272b767 00000020:01000004:3.0:1789185440.363856:0:6674:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789185440.363995:0:6674:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789185440.363999:0:6674:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789185440.364007:0:6674:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789185440.364012:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789185440.364026:0:6674:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c7936dd3380) 00000020:00000080:3.0:1789185440.364038:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789185440.365810:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185440.366026:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789185440.366033:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789185440.370505:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789185440.370520:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789185440.371101:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789185440.371108:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789185440.376265:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185440.376542:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789185440.376549:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789185440.385612:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789185440.385633:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789185440.420833:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185440.421259:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789185440.421668:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789185440.423504:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789185440.423520:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789185440.425388:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789185440.425434:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789185440.428450:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789185440.429166:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789185440.429175:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789185440.430272:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789185440.430282:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789185440.489191:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185440.490679:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789185440.490690:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789185440.491715:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789185440.491725:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789185440.492146:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789185440.492182:0:6674:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789185440.492194:0:6674:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789185440.521816:0:6674:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789185440.521861:0:6674:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.154@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789185440.521942:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789185440.521944:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789185440.521945:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185440.521947:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185440.521948:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185440.521949:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185440.521951:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185440.521952:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789185440.521953:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789185440.521955:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185440.521957:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789185440.521961:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789185440.521963:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789185440.521964:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789185440.521965:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185440.521966:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185440.521967:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185440.521968:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185440.521969:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185440.521970:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789185440.521971:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789185440.521972:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185440.521973:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789185440.522001:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789185440.522019:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821761024:0@lo:253: 00000100:00100000:2.0:1789185440.522093:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185440.522201:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821761024 00000100:00100000:1.0:1789185440.522209:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821761024 00000100:00100000:2.0:1789185440.522211:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82180 going to sleep for 11 seconds 00000100:00100000:1.0:1789185440.525247:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789185440.525276:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6674:x1876096821761024:12345-0@lo:253: 20000000:01000000:1.0:1789185440.525346:0:5815:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789185440.525350:0:5815:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789185440.525355:0:5815:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789185440.525359:0:5815:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789185440.529558:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789185440.529798:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789185440.529813:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789185440.529854:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1789185440.529863:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789185440.529895:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1789185440.531755:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789185440.540841:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789185440.540881:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.154@tcp 20000000:01000000:0.0:1789185440.540884:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.154@tcp (null) (null) (null) 00000040:00080000:0.0:1789185440.541054:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789185440.541066:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789185440.543201:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789185440.543227:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.154@tcp (null) (null) 00000040:00080000:2.0:1789185440.543535:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789185440.543564:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789185440.543601:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789185440.543655:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1789185440.544458:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789185440.544482:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.154@tcp 20000000:01000000:2.0:1789185440.544484:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.154@tcp (null) (null) (null) 00000040:00080000:2.0:1789185440.544519:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789185440.544526:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789185440.544555:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789185440.544562:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.154@tcp (null) (null) 00000040:00080000:2.0:1789185440.544607:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789185440.544617:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789185440.544652:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1789185440.544692:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1789185440.544711:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789185440.544714:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789185440.544718:0:5815:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789185440.544731:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789185440.544733:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789185440.544767:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789185440.544770:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789185440.556448:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789185440.556552:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789185440.556605:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789185440.557082:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789185440.557129:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789185440.557196:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789185440.557211:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789185440.557215:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789185440.560947:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1789185440.561246:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1789185440.561297:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1789185440.561376:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1789185440.561392:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789185440.561395:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789185440.564974:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1789185440.565075:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1789185440.565131:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789185440.565471:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1789185440.565517:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1789185440.565562:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1789185440.565578:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1789185440.565581:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1789185440.565591:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789185440.565612:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c79013ec000/0x532743011272b775 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185440.565632:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7900030800/0x532743011272b68e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b687 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185440.565652:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79013ed000/0x532743011272b6aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b6a3 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185440.565659:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79013ed600/0x532743011272b71a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b713 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185440.565666:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c79013ec000/0x532743011272b775 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185440.565709:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79013ed600/0x532743011272b71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b713 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185440.565726:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c79013ed600/0x532743011272b71a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b713 expref: 12 pid: 5817 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185440.565739:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821761152:0@lo:104: 00000100:00100000:1.0:1789185440.565806:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789185440.565874:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79013ed000/0x532743011272b6aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b6a3 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185440.565882:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c79013ed000/0x532743011272b6aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b6a3 expref: 12 pid: 5817 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185440.565902:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821761280:0@lo:104: 00000100:00100000:1.0:1789185440.565925:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185440.566016:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821761152 00000100:00100000:3.0:1789185440.566025:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821761152 00000100:00100000:3.0:1789185440.566059:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821761280 00000100:00100000:3.0:1789185440.566061:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821761280 00000100:00100000:3.0:1789185440.566075:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185440.566084:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+4:5815:x1876096821761152:12345-0@lo:104: 00010000:00010000:3.0:1789185440.566096:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b71a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185440.569243:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789185440.569261:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+4:5815:x1876096821761152:12345-0@lo:104: Request processed in 3174us (3451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185440.569288:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185440.569328:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185440.569340:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:5815:x1876096821761280:12345-0@lo:104: 00010000:00010000:3.0:1789185440.569358:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b6a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b6aa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185440.569471:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789185440.569476:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:5815:x1876096821761280:12345-0@lo:104: Request processed in 142us (3551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185440.569483:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789185440.569598:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789185440.569607:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b71a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.569623:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013edc00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:2.0:1789185440.569628:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b71a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.569638:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b71a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185440.569647:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b71a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185440.569653:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789185440.569705:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b71a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.569712:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185440.569734:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b713 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b71a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.569741:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b713 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b71a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.569757:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185440.569760:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b6a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b6aa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.569766:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7901520c00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:2.0:1789185440.569769:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b6a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b6aa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.569787:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b6aa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185440.569794:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b6aa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185440.569799:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789185440.569812:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b6a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b6aa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.569819:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185440.569825:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b6a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b6aa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.569832:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b6a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b6aa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.569843:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185440.569844:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185440.569846:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185440.569880:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821761536:0@lo:103: 00000100:00100000:2.0:1789185440.569925:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185440.569963:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185440.569969:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821761408:0@lo:103: 00000100:00100000:2.0:1789185440.569990:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185440.570016:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821761536 00000100:00100000:2.0:1789185440.570025:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821761536 00010000:00010000:2.0:1789185440.570056:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79013ed000/0x532743011272b6aa lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b6a3 expref: 13 pid: 5817 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185440.570089:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821761408 00000100:00100000:2.0:1789185440.570092:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821761408 00010000:00010000:2.0:1789185440.570104:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79013ed600/0x532743011272b71a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b713 expref: 14 pid: 5817 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185440.570115:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185440.570122:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+14:3279:x1876096821761536:12345-0@lo:103: 00010000:00010000:2.0:1789185440.570133:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185440.570138:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79013ed000/0x532743011272b6aa lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b6a3 expref: 14 pid: 5817 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.570142:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185440.570148:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79013ed000/0x532743011272b6aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b6a3 expref: 14 pid: 5817 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185440.570153:0:5809:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789185440.570161:0:5809:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1789185440.570164:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185440.570193:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+14:3279:x1876096821761536:12345-0@lo:103: Request processed in 72us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185440.570199:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185440.570214:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789185440.570220:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+13:3279:x1876096821761408:12345-0@lo:103: 00010000:00010000:2.0:1789185440.570226:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185440.570241:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79013ed600/0x532743011272b71a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b713 expref: 13 pid: 5817 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.570252:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79013ed600/0x532743011272b71a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b713 expref: 13 pid: 5817 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.570261:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185440.570299:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+13:3279:x1876096821761408:12345-0@lo:103: Request processed in 78us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185440.570305:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789185440.570337:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821761408:0@lo:103: 00000100:00100000:2.0:1789185440.570346:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821761536:0@lo:103: 00010000:00010000:1.0:1789185440.577622:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7900030800/0x532743011272b68e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b687 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185440.577657:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7900030800/0x532743011272b68e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b687 expref: 12 pid: 5816 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185440.577672:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821761664:0@lo:104: 00000100:00100000:1.0:1789185440.577734:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185440.577805:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79102910c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789185440.577831:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79013ed600/0x532743011272b71a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b713 expref: 12 pid: 5817 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185440.577846:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821761152:0@lo:104: 00010000:00010000:1.0:1789185440.577857:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79013ed000/0x532743011272b6aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b6a3 expref: 11 pid: 5817 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185440.577865:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821761280:0@lo:104: 00000100:00100000:0.0:1789185440.578772:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821761664 00000100:00100000:0.0:1789185440.578784:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821761664 00000100:00100000:0.0:1789185440.578849:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789185440.578860:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+3:5815:x1876096821761664:12345-0@lo:104: 00010000:00010000:0.0:1789185440.578875:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b68e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.578961:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789185440.578967:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+3:5815:x1876096821761664:12345-0@lo:104: Request processed in 111us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185440.578975:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789185440.580264:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821761664:0@lo:104: 00010000:00010000:1.0:1789185440.580296:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c79013ec000/0x532743011272b775 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582318:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185440.582333:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b68e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582345:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6c00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:2.0:1789185440.582349:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b68e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582360:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b68e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185440.582367:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b68e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185440.582373:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789185440.582458:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b687 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b68e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582465:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185440.582497:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b687 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b68e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582505:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b687 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b68e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185440.582514:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821761792:0@lo:103: 00010000:00010000:2.0:1789185440.582548:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185440.582550:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185440.582551:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185440.582577:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185440.582752:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821761792 00000100:00100000:2.0:1789185440.582760:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821761792 00010000:00010000:2.0:1789185440.582791:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7900030800/0x532743011272b68e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b687 expref: 11 pid: 5816 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185440.582826:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789185440.582836:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+11:3280:x1876096821761792:12345-0@lo:103: 00010000:00010000:2.0:1789185440.582847:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185440.582852:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7900030800/0x532743011272b68e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b687 expref: 11 pid: 5816 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582864:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7900030800/0x532743011272b68e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b687 expref: 11 pid: 5816 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582878:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7900030800/0x532743011272b68e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b687 expref: 11 pid: 5816 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582892:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c79013ec000/0x532743011272b775 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582901:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79013ec000/0x532743011272b775 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582917:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c79013ec000/0x532743011272b775 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582924:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c79013ec000/0x532743011272b775 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582940:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c79013ec000/0x532743011272b775 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582945:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c79013ec000/0x532743011272b775 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582950:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ec000 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185440.582953:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c79013ec000/0x532743011272b775 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582961:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c79013ec000/0x532743011272b775 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582983:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c79013ec000/0x532743011272b775 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.582994:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185440.583026:0:5815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c79013ec000/0x532743011272b775 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185440.583035:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c79013ec000/0x532743011272b775 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185440.583041:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79013ec000/0x532743011272b775 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185440.583042:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+10:3280:x1876096821761792:12345-0@lo:103: Request processed in 209us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185440.583049:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:3.0:1789185440.583057:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789185440.583827:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821761792:0@lo:103: 00000100:00100000:1.0:1789185440.636570:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+9:6674:x1876096821761024:12345-0@lo:253: Request processed in 111300us (114465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185440.636585:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789185440.636737:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821761024:0@lo:253: 10000000:01000000:2.0:1789185440.636754:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789185440.636758:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789185440.636759:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789185440.636761:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185440.636762:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789185440.636763:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185440.636764:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185440.636766:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185440.636767:0:6674:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789185440.636769:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185440.636785:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789185440.636806:0:6674:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c791f9b0000 from lustre-OST0000 10000000:01000000:2.0:1789185440.636833:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789185440.636836:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789185440.636843:0:6674:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c7907233380 local copy 10000000:01000000:2.0:1789185440.636847:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789185440.636962:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b77c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.636975:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b77c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.636984:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b77c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185440.637001:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821761920:0@lo:101: 00000100:00100000:2.0:1789185440.637035:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185440.637203:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c820c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185440.637295:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821761920 00000100:00100000:0.0:1789185440.637378:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821761920 00000100:00100000:0.0:1789185440.637545:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789185440.637564:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+9:6674:x1876096821761920:12345-0@lo:101: 00010000:00010000:0.0:1789185440.637580:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185440.637595:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7900030a00/0x532743011272b783 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b77c expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.637619:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7900030a00/0x532743011272b783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b77c expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.637631:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7900030a00/0x532743011272b783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b77c expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.637639:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7900030a00, rc 0) 00000100:00100000:0.0:1789185440.637686:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+10:6674:x1876096821761920:12345-0@lo:101: Request processed in 124us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185440.637692:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789185440.637763:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821761920:0@lo:101: 00010000:00010000:2.0:1789185440.637776:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b77c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x532743011272b783 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.637785:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b77c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x532743011272b783 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185440.637915:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821762048:0@lo:501: 00000100:00100000:2.0:1789185440.637940:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185440.638107:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c820c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185440.638255:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821762048 00000100:00100000:3.0:1789185440.638260:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821762048 00000100:00100000:3.0:1789185440.638285:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789185440.638292:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+10:6674:x1876096821762048:12345-0@lo:501: 00000100:00100000:3.0:1789185440.638626:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+10:6674:x1876096821762048:12345-0@lo:501: Request processed in 333us (684us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789185440.638633:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789185440.638776:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821762048:0@lo:501: 10000000:01000000:2.0:1789185440.638791:0:6674:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789185440.638823:0:6674:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789185440.638829:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b77c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x532743011272b783 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.638839:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b77c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x532743011272b783 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.638845:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b77c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x532743011272b783 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.638939:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789185440.638962:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c791f9b0000 10000000:01000000:2.0:1789185440.638967:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789185440.638972:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c7907233380 10000000:01000000:2.0:1789185440.638975:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789185440.638978:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c7907233380 from 1 10000000:01000000:2.0:1789185440.638980:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789185440.639003:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d7400/0x532743011272b78a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.639010:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79234d7400/0x532743011272b78a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.639020:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79234d7400/0x532743011272b78a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185440.639034:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821762176:0@lo:101: 00000100:00100000:2.0:1789185440.639061:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185440.639144:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185440.639152:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b77c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x532743011272b783 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.639160:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6c00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:0.0:1789185440.639164:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b77c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x532743011272b783 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.639172:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b77c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x532743011272b783 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185440.639179:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b77c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x532743011272b783 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185440.639185:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185440.639212:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b77c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x532743011272b783 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.639219:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185440.639255:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b77c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x532743011272b783 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.639264:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79234d6c00/0x532743011272b77c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x532743011272b783 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.639280:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185440.639281:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185440.639283:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185440.639293:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821762304:0@lo:103: 00000100:00100000:2.0:1789185440.639492:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185440.639588:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185440.639628:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821762304 00000100:00100000:0.0:1789185440.639633:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821762304 00000100:00100000:0.0:1789185440.639671:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185440.639679:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906615880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ad68fcc-785c-4134-99e9-eee8a8012753+10:3281:x1876096821762304:12345-0@lo:103: 00010000:00010000:0.0:1789185440.639690:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185440.639704:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7900030a00/0x532743011272b783 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x532743011272b77c expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.639720:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185440.639751:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906615880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ad68fcc-785c-4134-99e9-eee8a8012753+9:3281:x1876096821762304:12345-0@lo:103: Request processed in 73us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185440.639758:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185440.639783:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821762304:0@lo:103: 00000100:00100000:1.0:1789185440.639967:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821762176 00000100:00100000:1.0:1789185440.639973:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821762176 00000100:00100000:3.0:1789185440.640053:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789185440.640062:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+9:6674:x1876096821762176:12345-0@lo:101: 00010000:00010000:3.0:1789185440.640074:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185440.640160:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7901521400/0x532743011272b791 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b78a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185440.640181:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7901521400/0x532743011272b791 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b78a expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185440.640202:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7901521400/0x532743011272b791 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b78a expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185440.640209:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7901521400, rc 0) 00000100:00100000:3.0:1789185440.640262:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+10:6674:x1876096821762176:12345-0@lo:101: Request processed in 200us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185440.640267:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789185440.640443:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821762176:0@lo:101: 00010000:00010000:2.0:1789185440.640465:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79234d7400/0x532743011272b78a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b791 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.640474:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79234d7400/0x532743011272b78a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b791 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185440.640490:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789185440.640503:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d7400/0x532743011272b78a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b791 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.640512:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79234d7400/0x532743011272b78a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b791 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185440.640519:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789185440.640524:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789185440.640530:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789185440.640532:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789185440.640549:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b798 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.640556:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b798 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.640564:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b798 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185440.640578:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821762432:0@lo:101: 00000100:00100000:2.0:1789185440.640603:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185440.640617:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185440.640716:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821762432 00000100:00100000:0.0:1789185440.640729:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821762432 00000100:00100000:0.0:1789185440.640754:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789185440.640761:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+10:6674:x1876096821762432:12345-0@lo:101: 00010000:00010000:0.0:1789185440.640768:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185440.640781:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7900030800/0x532743011272b79f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b798 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.640794:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7900030800/0x532743011272b79f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b798 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.640802:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7900030800/0x532743011272b79f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b798 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.640808:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7900030800, rc 0) 00000100:00100000:0.0:1789185440.640837:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:6674:x1876096821762432:12345-0@lo:101: Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185440.640843:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789185440.641000:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821762432:0@lo:101: 00010000:00010000:2.0:1789185440.641017:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b798 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b79f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185440.641025:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b798 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b79f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185440.641195:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821762560:0@lo:501: 00000100:00100000:2.0:1789185440.641220:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185440.641258:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185440.641380:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821762560 00000100:00100000:0.0:1789185440.641385:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821762560 00000100:00100000:0.0:1789185440.641443:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789185440.641450:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:6674:x1876096821762560:12345-0@lo:501: 00000100:00100000:0.0:1789185440.641675:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:6674:x1876096821762560:12345-0@lo:501: Request processed in 225us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185440.641681:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789185440.642201:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821762560:0@lo:501: 00000100:00100000:2.0:1789185440.642250:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821762688:0@lo:503: 00000100:00100000:2.0:1789185440.642294:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185440.642441:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185440.642527:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821762688 00000100:00100000:0.0:1789185440.642532:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821762688 00000100:00100000:0.0:1789185440.642561:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789185440.642569:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:6674:x1876096821762688:12345-0@lo:503: 00000100:00100000:0.0:1789185440.642756:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:6674:x1876096821762688:12345-0@lo:503: Request processed in 187us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185440.642770:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789185440.642967:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821762688:0@lo:503: 00000040:00080000:3.0:1789185440.644251:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789185440.644730:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821762816:0@lo:502: 00000100:00100000:3.0:1789185440.644809:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185440.644984:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791f9e9180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185440.645057:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821762816 00000100:00100000:0.0:1789185440.645064:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821762816 00000100:00100000:0.0:1789185440.645103:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789185440.645111:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:6674:x1876096821762816:12345-0@lo:502: 00000100:00100000:3.0:1789185440.645462:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821762816:0@lo:502: 00000040:00080000:3.0:1789185440.645719:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789185440.645764:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789185440.645790:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789185440.645826:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789185440.645854:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789185440.645959:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789185440.645984:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821762944:0@lo:502: 00000100:00100000:3.0:1789185440.646024:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185440.646042:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791f9e9180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185440.646187:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:6674:x1876096821762816:12345-0@lo:502: Request processed in 189us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185440.646197:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789185440.646241:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821762944 00000100:00100000:0.0:1789185440.646246:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821762944 00000100:00100000:0.0:1789185440.646267:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789185440.646273:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:6674:x1876096821762944:12345-0@lo:502: 00000100:00100000:0.0:1789185440.646502:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:6674:x1876096821762944:12345-0@lo:502: Request processed in 228us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185440.646508:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789185440.646641:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821762944:0@lo:502: 00000040:00080000:3.0:1789185440.646719:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789185440.646729:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1789185440.648828:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789185440.648840:0:6693:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789185440.648847:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185440.648850:0:6693:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789185440.648856:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789185440.648950:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c79072319c0) 00000020:00000080:1.0:1789185440.648973:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789185440.648980:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789185440.649039:0:6693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c791f9b0000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789185440.649048:0:6693:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789185440.649055:0:6693:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x532743011272b7ad 00010000:00010000:0.0:1789185440.657830:0:6693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1789185440.658588:0:6693:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789185440.662250:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789185440.663600:0:6693:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789185440.680274:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789185440.681193:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789185440.683928:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789185440.683943:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185440.683950:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185440.683952:0:6693:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789185440.683955:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185440.683960:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185440.683961:0:6693:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789185440.683965:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789185440.683967:0:6693:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789185440.684024:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185440.684028:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185440.684029:0:6693:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789185440.684038:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789185440.686206:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789185440.686262:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789185440.686279:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b798 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b79f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185440.686293:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b79f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185440.686311:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c791f9b0000 from 1 10000000:01000000:3.0:1789185440.686314:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185440.686353:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901520e00/0x532743011272b7b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185440.686361:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7901520e00/0x532743011272b7b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185440.686372:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7901520e00/0x532743011272b7b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185440.686396:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763072:0@lo:101: 00000100:00100000:3.0:1789185440.686482:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185440.686527:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791f9e9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185440.687018:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821763072 00000100:00100000:0.0:1789185440.687028:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821763072 00000100:00100000:0.0:1789185440.687089:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789185440.687099:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:6674:x1876096821763072:12345-0@lo:101: 00010000:00010000:0.0:1789185440.687113:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185440.687126:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7900030a00/0x532743011272b7bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b7b4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.687167:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7900030a00/0x532743011272b7bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b7b4 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.687178:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7900030a00/0x532743011272b7bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b7b4 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.687187:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7900030a00, rc 0) 00000100:00100000:0.0:1789185440.687240:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6674:x1876096821763072:12345-0@lo:101: Request processed in 132us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185440.687247:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789185440.688476:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763072:0@lo:101: 00010000:00010000:3.0:1789185440.688501:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7901520e00/0x532743011272b7b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b7bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185440.688513:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7901520e00/0x532743011272b7b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b7bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185440.688668:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763200:0@lo:501: 00000100:00100000:3.0:1789185440.688718:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185440.688753:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791f9e9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185440.688781:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821763200 00000100:00100000:3.0:1789185440.688787:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821763200 00000100:00100000:3.0:1789185440.688824:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789185440.688833:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6674:x1876096821763200:12345-0@lo:501: 00000100:00100000:3.0:1789185440.691251:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6674:x1876096821763200:12345-0@lo:501: Request processed in 2411us (2524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185440.691264:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789185440.691459:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763200:0@lo:501: 00000100:00100000:2.0:1789185440.691513:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763328:0@lo:503: 00000100:00100000:2.0:1789185440.691562:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185440.691596:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82240 going to sleep for 11 seconds 00000100:00100000:3.0:1789185440.691989:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821763328 00000100:00100000:3.0:1789185440.691996:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821763328 00000100:00100000:3.0:1789185440.692033:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789185440.692041:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6674:x1876096821763328:12345-0@lo:503: 00000100:00100000:3.0:1789185440.693714:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6674:x1876096821763328:12345-0@lo:503: Request processed in 1666us (2145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185440.693725:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789185440.694255:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763328:0@lo:503: 00000040:00080000:2.0:1789185440.694644:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789185440.694719:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763456:0@lo:502: 00000100:00100000:2.0:1789185440.694773:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185440.694806:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82240 going to sleep for 11 seconds 00000100:00100000:1.0:1789185440.695198:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821763456 00000100:00100000:1.0:1789185440.695206:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821763456 00000100:00100000:1.0:1789185440.695266:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789185440.695275:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6674:x1876096821763456:12345-0@lo:502: 00000100:00100000:1.0:1789185440.697643:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6674:x1876096821763456:12345-0@lo:502: Request processed in 2360us (2859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185440.697657:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789185440.697943:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763456:0@lo:502: 00000040:00080000:2.0:1789185440.698287:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789185440.699264:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789185440.699402:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763584:0@lo:502: 00000100:00100000:2.0:1789185440.699497:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185440.699544:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82240 going to sleep for 11 seconds 00000100:00100000:3.0:1789185440.699997:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821763584 00000100:00100000:3.0:1789185440.700006:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821763584 00000100:00100000:3.0:1789185440.700058:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789185440.700067:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6674:x1876096821763584:12345-0@lo:502: 00000100:00100000:3.0:1789185440.700681:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6674:x1876096821763584:12345-0@lo:502: Request processed in 613us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185440.700691:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789185440.700833:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763584:0@lo:502: 00000040:00080000:2.0:1789185440.702197:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789185440.702218:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789185440.705817:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185440.705831:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185440.705834:0:6697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789185440.705841:0:6697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c791f9b0000 00000020:00000080:2.0:1789185440.705843:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789185440.707380:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185440.707395:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185440.707398:0:6697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789185440.707417:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789185440.708193:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789185440.708255:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185440.708283:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901520e00/0x532743011272b7b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b7bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185440.708295:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7901520e00/0x532743011272b7b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b7bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185440.708350:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789185440.708353:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c791f9b0000 10000000:01000000:3.0:1789185440.708356:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c791f9b0000 10000000:01000000:3.0:1789185440.708360:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789185440.708366:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c791f9b0000 from 1 10000000:01000000:3.0:1789185440.708369:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789185440.708442:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b7c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185440.708453:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b7c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185440.708464:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b7c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185440.708493:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763712:0@lo:101: 00000100:00100000:3.0:1789185440.708580:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185440.708616:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79105df180 going to sleep for 11 seconds 00000100:00100000:1.0:1789185440.708909:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821763712 00000100:00100000:1.0:1789185440.708916:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821763712 00000100:00100000:1.0:1789185440.708966:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789185440.708976:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6674:x1876096821763712:12345-0@lo:101: 00010000:00010000:1.0:1789185440.708991:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185440.709004:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79013ed000/0x532743011272b7c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b7c2 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185440.709042:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79013ed000/0x532743011272b7c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b7c2 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185440.709054:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79013ed000/0x532743011272b7c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b7c2 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185440.709063:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013ed000, rc 0) 00000100:00100000:1.0:1789185440.709117:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:6674:x1876096821763712:12345-0@lo:101: Request processed in 142us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185440.709123:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789185440.709785:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763712:0@lo:101: 00010000:00010000:3.0:1789185440.709805:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b7c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b7c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185440.709814:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b7c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b7c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185440.710480:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763840:0@lo:501: 00000100:00100000:3.0:1789185440.710529:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185440.710564:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79105df180 going to sleep for 11 seconds 00000100:00100000:2.0:1789185440.711293:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821763840 00000100:00100000:2.0:1789185440.711310:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821763840 00000100:00100000:2.0:1789185440.711361:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789185440.711371:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+13:6674:x1876096821763840:12345-0@lo:501: 00000100:00100000:2.0:1789185440.711672:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+13:6674:x1876096821763840:12345-0@lo:501: Request processed in 301us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185440.711680:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789185440.712035:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763840:0@lo:501: 00000100:00100000:3.0:1789185440.712077:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763968:0@lo:503: 00000100:00100000:3.0:1789185440.712682:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185440.712716:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79105df180 going to sleep for 11 seconds 00000100:00100000:2.0:1789185440.713214:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821763968 00000100:00100000:2.0:1789185440.713241:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821763968 00000100:00100000:2.0:1789185440.714213:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789185440.714239:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:6674:x1876096821763968:12345-0@lo:503: 00000100:00100000:2.0:1789185440.715000:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:6674:x1876096821763968:12345-0@lo:503: Request processed in 770us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185440.715018:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789185440.715350:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821763968:0@lo:503: 00000040:00080000:3.0:1789185440.715707:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789185440.715791:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821764096:0@lo:502: 00000100:00100000:3.0:1789185440.715843:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185440.715971:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821764096 00000100:00100000:1.0:1789185440.715978:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821764096 00000100:00100000:1.0:1789185440.716020:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789185440.716029:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:6674:x1876096821764096:12345-0@lo:502: 00000100:00100000:3.0:1789185440.716469:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79105df180 going to sleep for 11 seconds 00000100:00100000:1.0:1789185440.716807:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:6674:x1876096821764096:12345-0@lo:502: Request processed in 778us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185440.716817:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789185440.717851:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821764096:0@lo:502: 00000040:00080000:3.0:1789185440.718663:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789185440.718733:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789185440.718767:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789185440.718813:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789185440.718846:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789185440.718966:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789185440.719016:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789185440.719048:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789185440.719169:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789185440.719204:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789185440.719248:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789185440.719290:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789185440.719648:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789185440.719698:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789185440.719746:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789185440.719781:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789185440.719815:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789185440.719955:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789185440.719997:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789185440.720036:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789185440.720183:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789185440.720226:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789185440.720758:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789185440.720816:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789185440.720849:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789185440.720964:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789185440.721011:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789185440.721043:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1789185440.721170:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821764224:0@lo:502: 00000100:00100000:3.0:1789185440.721272:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185440.721465:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79105df180 going to sleep for 11 seconds 00000100:00100000:2.0:1789185440.723187:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821764224 00000100:00100000:2.0:1789185440.723201:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821764224 00000100:00100000:3.0:1789185440.723508:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789185440.723521:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:6674:x1876096821764224:12345-0@lo:502: 00000100:00100000:3.0:1789185440.723838:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:6674:x1876096821764224:12345-0@lo:502: Request processed in 319us (2566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185440.723845:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789185440.723974:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821764224:0@lo:502: 00000040:00080000:0.0:1789185440.724110:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789185440.724128:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789185440.725178:0:6698:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789185440.725195:0:6698:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c790661cd40) 00000020:00000080:0.0:1789185440.725217:0:6698:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789185440.725439:0:6698:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c791f9b0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789185440.725445:0:6698:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c791f9b0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789185440.725448:0:6698:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c791f9b0000 3 00010000:00080000:0.0:1789185440.725480:0:6698:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7936dc8800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.154@tcp at head 00010000:00010000:1.0:1789185440.729284:0:6698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1789185440.729775:0:6698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789185440.729814:0:6698:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789185440.729828:0:6698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x532743011272b7d7 00000100:00080000:1.0:1789185440.729839:0:6698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789185440.729851:0:6698:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c7936dc8800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:1.0:1789185440.729897:0:6698:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7936dbc700 x1876096821764352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789185440.729926:0:6698:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789185440.730040:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1876096821764352:0@lo:38: 00000100:00100000:3.0:1789185440.730122:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185440.730195:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821764352 00000100:00100000:3.0:1789185440.730203:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821764352 00000100:00100000:3.0:1789185440.730249:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185440.730257:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3277:x1876096821764352:12345-0@lo:38: 00010000:00080000:3.0:1789185440.730308:0:5823:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 137 last 0 00000020:00000080:3.0:1789185440.730343:0:5823:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x532743011272b7de 00000004:00100000:3.0:1789185440.730357:0:5823:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789185440.730387:0:5823:0:(import.c:65:import_set_state_nolock()) ffff9c793f283800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185440.730460:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876096821764352:12345-0@lo:38: Request processed in 202us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185440.730467:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789185440.730506:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7936dbc700 x1876096821764352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185440.730516:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789185440.730524:0:3277:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789185440.730530:0:3277:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789185440.730535:0:3277:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789185440.730537:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c7936dc8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789185440.730543:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1876096821764352:0@lo:38: 00000040:00080000:3.0:1789185440.732441:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1789185440.732670:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789185440.732704:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789185440.732731:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b7c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b7c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185440.732743:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b7c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789185440.732788:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789185440.732791:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789185440.732792:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789185440.732793:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789185440.732794:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789185440.732796:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789185440.732797:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789185440.732799:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789185440.732800:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789185440.732802:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789185440.732803:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789185440.732807:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789185440.732809:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789185440.732811:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789185440.732812:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789185440.732813:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789185440.732814:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789185440.732815:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789185440.732816:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789185440.732817:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789185440.732818:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789185440.732819:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789185440.732820:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789185440.732850:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789185440.732881:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821764480:0@lo:253: 00000100:00100000:1.0:1789185440.732949:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185440.732985:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7910291180 going to sleep for 11 seconds 00000100:00100000:1.0:1789185440.733015:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821764480 00000100:00100000:1.0:1789185440.733022:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821764480 00000100:00100000:1.0:1789185440.733073:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789185440.733094:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:6674:x1876096821764480:12345-0@lo:253: 20000000:01000000:1.0:1789185440.733122:0:5816:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789185440.733136:0:5816:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789185440.735705:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185440.735732:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821764608:0@lo:400: 00000100:00100000:0.0:1789185440.735800:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185440.735844:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821764608 00000100:00100000:0.0:1789185440.735851:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821764608 00000100:00100000:0.0:1789185440.735909:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789185440.735919:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821764608:12345-0@lo:400: 00000100:00100000:0.0:1789185440.735969:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821764608:12345-0@lo:400: Request processed in 51us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185440.735975:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789185440.736014:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7906615c00 x1876096821764608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185440.736028:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821764608:0@lo:400: 20000000:01000000:1.0:1789185440.760427:0:5816:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789185440.760446:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789185440.761015:0:5838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789185440.761022:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789185440.761047:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7900030200/0x532743011272b7e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.761066:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79234d7600/0x532743011272b744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b73d expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.761075:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7900030200/0x532743011272b7e5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.761131:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79234d7600/0x532743011272b744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b73d expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.761147:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c79234d7600/0x532743011272b744 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b73d expref: 13 pid: 5817 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185440.761162:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1876096821764736:0@lo:104: 00000100:00100000:0.0:1789185440.761254:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185440.761300:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c793f51e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789185440.761447:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821764736 00000100:00100000:0.0:1789185440.761456:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821764736 00000100:00100000:0.0:1789185440.761506:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185440.761516:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906617100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+3:5838:x1876096821764736:12345-0@lo:104: 00010000:00010000:0.0:1789185440.761529:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b73d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b744 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.761582:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789185440.761587:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906617100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+3:5838:x1876096821764736:12345-0@lo:104: Request processed in 73us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185440.761594:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789185440.761621:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185440.761626:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b73d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b744 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.761633:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7900031c00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:0.0:1789185440.761637:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b73d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b744 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.761646:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b73d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b744 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185440.761653:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b73d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b744 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185440.761658:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185440.761687:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b73d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b744 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.761705:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185440.761723:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b73d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b744 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.761730:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b73d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b744 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.761746:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185440.761748:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185440.761749:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185440.761762:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821764864:0@lo:103: 00000100:00100000:0.0:1789185440.761793:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185440.761828:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821764864 00000100:00100000:0.0:1789185440.761832:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821764864 00010000:00010000:0.0:1789185440.761848:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79234d7600/0x532743011272b744 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b73d expref: 14 pid: 5817 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185440.762155:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185440.762163:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791f906450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+14:3279:x1876096821764864:12345-0@lo:103: 00010000:00010000:0.0:1789185440.762174:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185440.762179:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79234d7600/0x532743011272b744 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b73d expref: 14 pid: 5817 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.762191:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79234d7600/0x532743011272b744 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b73d expref: 14 pid: 5817 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.762208:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7900030200/0x532743011272b7e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.762239:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7900030200/0x532743011272b7e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789185440.762254:0:5808:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003407789s 00010000:00010000:0.0:1789185440.762259:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7900030200/0x532743011272b7e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.762266:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7900030200/0x532743011272b7e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.762272:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7900030200/0x532743011272b7e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.762278:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7900030200/0x532743011272b7e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.762283:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7900030200 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185440.762286:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7900030200/0x532743011272b7e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.762293:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7900030200/0x532743011272b7e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.762384:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7900030200/0x532743011272b7e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185440.762395:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185440.762471:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791f906450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+14:3279:x1876096821764864:12345-0@lo:103: Request processed in 308us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185440.762477:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789185440.762597:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821764864:0@lo:103: 00010000:00010000:1.0:1789185440.763804:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d7600/0x532743011272b744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b73d expref: 13 pid: 5817 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185440.763823:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1876096821764736:0@lo:104: 00010000:00010000:1.0:1789185440.763843:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7900030200/0x532743011272b7e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185440.763852:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7900030200/0x532743011272b7e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185440.763858:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7900030200/0x532743011272b7e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185440.763876:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7900030200/0x532743011272b7e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185440.768225:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:6674:x1876096821764480:12345-0@lo:253: Request processed in 35135us (35266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185440.768250:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789185440.768571:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:6674:1876096821764480:0@lo:253: 10000000:01000000:2.0:1789185440.768589:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789185440.768592:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789185440.768594:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789185440.768595:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185440.768597:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185440.768598:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185440.768599:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185440.768601:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185440.768602:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789185440.768603:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789185440.768605:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185440.768606:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789185440.768620:0:6674:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789185440.775748:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789185440.775966:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789185440.776719:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789185440.776997:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789185440.777625:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789185440.777946:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789185440.779972:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1789185440.916028:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789185441.079609:0:6674:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789185441.079615:0:6674:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789185441.079645:0:6674:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789185441.079720:0:6674:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789185441.079737:0:6674:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789185441.079770:0:6674:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789185441.935620:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185442.959540:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185443.983817:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185445.007544:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789185445.266275:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789185445.266283:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c79102db000 from 21 10000000:01000000:1.0:1789185445.266288:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789185445.266361:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b7ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185445.266375:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b7ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185445.266387:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b7ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185445.267251:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821764992:0@lo:101: 00000100:00100000:1.0:1789185445.267328:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185445.269287:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79056b13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185445.271768:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821764992 00000100:00100000:0.0:1789185445.271784:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821764992 00000100:00100000:0.0:1789185445.271849:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789185445.271860:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5820:x1876096821764992:12345-0@lo:101: 00010000:00010000:0.0:1789185445.271879:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185445.271899:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7900030200/0x532743011272b7f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b7ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185445.271929:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7900030200/0x532743011272b7f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b7ec expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185445.271941:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7900030200/0x532743011272b7f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b7ec expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185445.271950:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7900030200, rc 0) 00000100:00100000:0.0:1789185445.272117:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:5820:x1876096821764992:12345-0@lo:101: Request processed in 257us (4786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185445.272133:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789185445.277728:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821764992:0@lo:101: 00010000:00010000:2.0:1789185445.277769:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b7ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b7f3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185445.277785:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b7ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b7f3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185445.277879:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821765120:0@lo:501: 00000100:00100000:2.0:1789185445.277951:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185445.277990:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7902ba8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185445.278925:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821765120 00000100:00100000:1.0:1789185445.278936:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821765120 00000100:00100000:1.0:1789185445.278998:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789185445.279009:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:5820:x1876096821765120:12345-0@lo:501: 00000100:00100000:1.0:1789185445.279940:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:5820:x1876096821765120:12345-0@lo:501: Request processed in 929us (1984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185445.279951:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789185445.280093:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821765120:0@lo:501: 00000100:00100000:3.0:1789185445.280153:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821765248:0@lo:503: 00000100:00100000:3.0:1789185445.280214:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185445.280251:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906befd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789185445.280360:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821765248 00000100:00100000:1.0:1789185445.280366:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821765248 00000100:00100000:1.0:1789185445.280598:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789185445.280611:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:5820:x1876096821765248:12345-0@lo:503: 00000100:00100000:1.0:1789185445.280945:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:5820:x1876096821765248:12345-0@lo:503: Request processed in 337us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185445.281007:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821765248:0@lo:503: 00000100:00100000:3.0:1789185445.281225:0:6870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:6870:1876096821765376:0@lo:502: 00000100:00100000:3.0:1789185445.281261:0:6870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185445.281285:0:6870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906bef480 going to sleep for 11 seconds 00000100:00100000:2.0:1789185445.285899:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821765376 00000100:00100000:2.0:1789185445.285940:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821765376 00000100:00100000:2.0:1789185445.285994:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789185445.286003:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:6870:x1876096821765376:12345-0@lo:502: 00000100:00100000:2.0:1789185445.287045:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:6870:x1876096821765376:12345-0@lo:502: Request processed in 1038us (5778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185445.287057:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789185445.287271:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789185445.293303:0:6870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:6870:1876096821765376:0@lo:502: 00000100:00100000:3.0:1789185445.293842:0:6870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:6870:1876096821765504:0@lo:502: 00000100:00100000:3.0:1789185445.293929:0:6870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185445.293979:0:6870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906bef480 going to sleep for 11 seconds 00000100:00100000:2.0:1789185445.294077:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821765504 00000100:00100000:2.0:1789185445.294084:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821765504 00000100:00100000:2.0:1789185445.294144:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789185445.294154:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+13:6870:x1876096821765504:12345-0@lo:502: 00000100:00100000:2.0:1789185445.294458:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+13:6870:x1876096821765504:12345-0@lo:502: Request processed in 304us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185445.294466:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789185445.295048:0:6870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:6870:1876096821765504:0@lo:502: 00000040:00080000:3.0:1789185445.295079:0:6870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789185445.295326:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789185445.295347:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789185445.295359:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b7ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b7f3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185445.295383:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b7ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b7f3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185445.295395:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789185445.295399:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c79102db000 from 4 10000000:01000000:1.0:1789185445.295445:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789185445.295481:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013ec400/0x532743011272b7fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185445.295491:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79013ec400/0x532743011272b7fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185445.295501:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79013ec400/0x532743011272b7fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185445.295520:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821765632:0@lo:101: 00000100:00100000:1.0:1789185445.295567:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185445.295596:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79056b1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185445.296004:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821765632 00000100:00100000:3.0:1789185445.296012:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821765632 00000100:00100000:3.0:1789185445.296057:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789185445.296066:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:5820:x1876096821765632:12345-0@lo:101: 00010000:00010000:3.0:1789185445.296078:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185445.296092:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7901520000/0x532743011272b801 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b7fa expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185445.296145:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7901520000/0x532743011272b801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b7fa expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185445.296154:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7901520000/0x532743011272b801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b7fa expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185445.296163:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7901520000, rc 0) 00000100:00100000:3.0:1789185445.296220:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821765632:12345-0@lo:101: Request processed in 154us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185445.296227:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789185445.296392:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821765632:0@lo:101: 00010000:00010000:1.0:1789185445.296454:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79013ec400/0x532743011272b7fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b801 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185445.296465:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79013ec400/0x532743011272b7fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b801 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185445.296513:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821765760:0@lo:256: 00000100:00100000:1.0:1789185445.296545:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185445.296577:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79056b1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185445.297301:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821765760 00000100:00100000:3.0:1789185445.297309:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821765760 00000100:00100000:3.0:1789185445.297356:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789185445.297366:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821765760:12345-0@lo:256: 20000000:01000000:3.0:1789185445.297384:0:5816:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789185445.297437:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789185445.297441:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789185445.297544:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821765760:12345-0@lo:256: Request processed in 179us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185445.297551:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789185445.298100:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821765760:0@lo:256: 10000000:01000000:0.0:1789185445.298163:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789185445.298171:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013ec400/0x532743011272b7fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b801 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185445.298184:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79013ec400/0x532743011272b7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b801 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185445.298203:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789185445.298206:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789185445.298209:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789185445.298246:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185445.298255:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185445.298266:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185445.298282:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821765888:0@lo:101: 00000100:00100000:0.0:1789185445.298319:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185445.298354:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c793f51e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185445.298607:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821765888 00000100:00100000:2.0:1789185445.298614:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821765888 00000100:00100000:2.0:1789185445.298664:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789185445.298673:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821765888:12345-0@lo:101: 00010000:00010000:2.0:1789185445.298683:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185445.298695:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d7800/0x532743011272b80f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b808 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185445.298719:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d7800/0x532743011272b80f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b808 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185445.298730:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d7800/0x532743011272b80f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b808 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185445.298738:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7800, rc 0) 00000100:00100000:2.0:1789185445.298781:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821765888:12345-0@lo:101: Request processed in 110us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185445.298795:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789185445.298946:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821765888:0@lo:101: 00010000:00010000:0.0:1789185445.298959:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b80f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185445.298967:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b80f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185445.299015:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821766016:0@lo:501: 00000100:00100000:0.0:1789185445.299041:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185445.299072:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c793f51e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185445.299158:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821766016 00000100:00100000:1.0:1789185445.299163:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821766016 00000100:00100000:1.0:1789185445.299184:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789185445.299203:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821766016:12345-0@lo:501: 00000100:00100000:1.0:1789185445.299770:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821766016:12345-0@lo:501: Request processed in 566us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185445.299778:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789185445.299848:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821766016:0@lo:501: 00000100:00100000:0.0:1789185445.299879:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821766144:0@lo:503: 00000100:00100000:0.0:1789185445.299918:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185445.299948:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c793f51e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185445.300015:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821766144 00000100:00100000:3.0:1789185445.300020:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821766144 00000100:00100000:3.0:1789185445.300045:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789185445.300052:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821766144:12345-0@lo:503: 00000100:00100000:3.0:1789185445.300392:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821766144:12345-0@lo:503: Request processed in 340us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185445.300400:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789185445.300772:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821766144:0@lo:503: 00000100:00100000:0.0:1789185445.304872:0:6871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:6871:1876096821766272:0@lo:502: 00000100:00100000:0.0:1789185445.304967:0:6871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185445.305014:0:6871:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79060a5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185445.307588:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821766272 00000100:00100000:3.0:1789185445.307606:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821766272 00000100:00100000:3.0:1789185445.307692:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789185445.307703:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+15:6871:x1876096821766272:12345-0@lo:502: 00000100:00100000:3.0:1789185445.308079:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+15:6871:x1876096821766272:12345-0@lo:502: Request processed in 377us (3111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185445.308087:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789185445.309610:0:6871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:6871:1876096821766272:0@lo:502: 00000020:01000000:1.0:1789185445.309675:0:6871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789185445.309685:0:6871:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789185445.309695:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185445.309698:0:6871:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789185445.309704:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789185445.309709:0:6871:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:1.0:1789185445.309736:0:6871:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789185445.309740:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789185445.309756:0:6871:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c7907230000) 00000020:00000080:1.0:1789185445.309779:0:6871:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789185445.309784:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789185445.309873:0:6871:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789185445.309879:0:6871:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789185445.309886:0:6871:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x532743011272b81d 00010000:00080000:1.0:1789185445.309918:0:6871:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c793f2db000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:1.0:1789185445.310168:0:6871:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789185445.379472:0:6871:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789185445.379502:0:6871:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789185445.380372:0:6871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185445.380598:0:6871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185445.380654:0:6871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789185445.381080:0:6871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789185445.395089:0:6875:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789185445.395098:0:6875:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789185445.397480:0:6871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789185445.397495:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789185445.397531:0:6871:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789185445.397552:0:6871:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x532743011272b824 00000100:00080000:1.0:1789185445.397568:0:6871:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789185445.397581:0:6871:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c793f2db000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:1.0:1789185445.397617:0:6871:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7936dbed80 x1876096821766400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789185445.397635:0:6871:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789185445.397711:0:6871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185445.397716:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185445.397718:0:6871:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789185445.397721:0:6871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185445.397725:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185445.397727:0:6871:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789185445.397730:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789185445.397732:0:6871:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789185445.397759:0:6871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:6871:1876096821766528:0@lo:502: 00000100:00100000:1.0:1789185445.397841:0:6871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185445.397947:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821766400:0@lo:8: 00000100:00100000:3.0:1789185445.397986:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185445.398152:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821766656:0@lo:400: 00000100:00100000:0.0:1789185445.398195:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185445.398227:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185445.398233:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906614700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821766784:0@lo:400: 00000100:00100000:0.0:1789185445.398257:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185445.398288:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821766656 00000100:00100000:0.0:1789185445.398295:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821766656 00000100:00100000:0.0:1789185445.398332:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821766784 00000100:00100000:0.0:1789185445.398335:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821766784 00000100:00100000:0.0:1789185445.398361:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185445.398367:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789185445.398369:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821766656:12345-0@lo:400: 00000100:00100000:3.0:1789185445.398375:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821766784:12345-0@lo:400: 00000100:00100000:0.0:1789185445.398443:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821766656:12345-0@lo:400: Request processed in 74us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185445.398450:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789185445.398474:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185445.398583:0:6871:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79056b1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185445.398694:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821766528 00000100:00100000:1.0:1789185445.398698:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821766528 00000100:00100000:1.0:1789185445.398723:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789185445.398729:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+15:6871:x1876096821766528:12345-0@lo:502: 00000100:00100000:1.0:1789185445.398961:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+15:6871:x1876096821766528:12345-0@lo:502: Request processed in 231us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185445.398969:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789185445.399028:0:6871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:6871:1876096821766528:0@lo:502: 00000020:01000000:1.0:1789185445.399056:0:6871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185445.399061:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185445.399063:0:6871:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789185445.399068:0:6871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789185445.399169:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789185445.399206:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789185445.399217:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b808 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b80f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185445.399230:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b80f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185445.399240:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789185445.399243:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c7907233380 from 1 10000000:01000000:1.0:1789185445.399246:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789185445.399270:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272b82b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185445.399280:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272b82b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185445.399289:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272b82b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185445.399303:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821766912:0@lo:101: 00000100:00100000:1.0:1789185445.399332:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185445.399350:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79056b1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185445.399369:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821766912 00000100:00100000:1.0:1789185445.399372:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821766912 00000100:00100000:1.0:1789185445.399395:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789185445.399402:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821766912:12345-0@lo:101: 00010000:00010000:1.0:1789185445.399442:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185445.399454:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79013ed800/0x532743011272b832 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b82b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185445.399487:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79013ed800/0x532743011272b832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b82b expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185445.399497:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79013ed800/0x532743011272b832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b82b expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185445.399505:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013ed800, rc 0) 00000100:00100000:1.0:1789185445.399533:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821766912:12345-0@lo:101: Request processed in 132us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185445.399539:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789185445.399567:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821766912:0@lo:101: 00010000:00010000:1.0:1789185445.399578:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272b82b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b832 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185445.399586:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272b82b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b832 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185445.399625:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821767040:0@lo:501: 00000100:00100000:1.0:1789185445.399647:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185445.399665:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79056b1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185445.399680:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821767040 00000100:00100000:1.0:1789185445.399684:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821767040 00000100:00100000:1.0:1789185445.399704:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789185445.399705:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821766400 00000100:00100000:2.0:1789185445.399709:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821766400 00000100:00100000:1.0:1789185445.399710:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821767040:12345-0@lo:501: 00000100:00100000:2.0:1789185445.399731:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185445.399736:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1876096821766400:12345-0@lo:8: 00010000:00080000:2.0:1789185445.399753:0:6676:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:2.0:1789185445.399780:0:6676:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x532743011272b839 00002000:00100000:2.0:1789185445.399812:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c7936994000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789185445.399816:0:6676:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789185445.399820:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789185445.399900:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821767040:12345-0@lo:501: Request processed in 189us (252us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789185445.399907:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00002000:00100000:2.0:1789185445.399913:0:6676:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789185445.399945:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821767040:0@lo:501: 10000000:01000000:1.0:1789185445.399962:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789185445.399967:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272b82b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b832 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185445.399974:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272b82b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b832 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185445.402955:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821766784:12345-0@lo:400: Request processed in 4575us (4690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185445.402972:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00080000:2.0:1789185445.403067:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789185445.403105:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9c7936995800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789185445.403198:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1876096821766400:12345-0@lo:8: Request processed in 3450us (5199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185445.403206:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789185445.403976:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7936dbed80 x1876096821766400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789185455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185445.403989:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789185445.404000:0:3277:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789185445.404009:0:3277:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789185445.404016:0:3277:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789185445.404018:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c793f2db000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789185445.404041:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789185445.404046:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821766400:0@lo:8: 00010000:00080000:0.0:1789185445.405025:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7906614700 x1876096821766784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185445.405040:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906614700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821766784:0@lo:400: 00000004:00080000:0.0:1789185445.405056:0:6875:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789185445.405263:0:6875:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 142444856563ns, next at 0ns, rc = 0 00010000:00080000:1.0:1789185445.413298:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7906616a00 x1876096821766656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185445.413320:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821766656:0@lo:400: 00000004:00080000:3.0:1789185445.524082:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789185445.524352:0:6877:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789185445.524383:0:6877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6877:1876096821767296:0@lo:7: 00000100:00100000:1.0:1789185445.524478:0:6877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185445.524529:0:6877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79056b19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185445.524548:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789185445.524558:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821767168:0@lo:13: 00000100:00100000:1.0:1789185445.524583:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185445.524618:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821767296 00000100:00100000:1.0:1789185445.524625:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821767296 00000100:00100000:1.0:1789185445.524678:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789185445.524686:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6877:x1876096821767296:12345-0@lo:7: 00000100:00080000:0.0:1789185445.525556:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185445.525580:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821767168 00000100:00100000:0.0:1789185445.525586:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821767168 00000100:00100000:0.0:1789185445.525626:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185445.525642:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1876096821767168:12345-0@lo:13: 00002000:00000024:0.0:1789185445.525670:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789185445.525740:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1876096821767168:12345-0@lo:13: Request processed in 100us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185445.525747:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789185445.525921:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7936dbf480 x1876096821767168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185445.525956:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821767168:0@lo:13: 00002000:00080000:1.0:1789185445.533723:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789185445.533733:0:6679:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00010000:00080000:2.0:1789185445.534212:0:6877:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7936dbce00 x1876096821767296/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789185461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185445.534231:0:6877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6877:1876096821767296:0@lo:7: 00000004:00080000:2.0:1789185445.534245:0:6877:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789185445.534285:0:6877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6877:1876096821767424:0@lo:5: 00000100:00100000:2.0:1789185445.534328:0:6877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185445.534385:0:6877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79105dfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185445.534600:0:6678:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789185445.534610:0:6678:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789185445.535003:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6877:x1876096821767296:12345-0@lo:7: Request processed in 9155us (9362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185445.535015:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789185445.535229:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821767424 00000100:00100000:2.0:1789185445.535237:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821767424 00000100:00100000:2.0:1789185445.535283:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185445.535293:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6877:x1876096821767424:12345-0@lo:5: 00002000:00080000:2.0:1789185445.535324:0:6678:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789185445.535328:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789185445.535678:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6877:x1876096821767424:12345-0@lo:5: Request processed in 385us (1348us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789185445.535684:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789185445.535723:0:6877:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7936db9180 x1876096821767424/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185445.535739:0:6877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6877:1876096821767424:0@lo:5: 00000004:00080000:2.0:1789185445.535750:0:6877:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789185445.535780:0:6877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6877:1876096821767552:0@lo:700: 00000100:00100000:2.0:1789185445.535809:0:6877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185445.535849:0:6877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7918d5e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789185445.536022:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821767552 00000100:00100000:3.0:1789185445.536028:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821767552 00000100:00100000:3.0:1789185445.537324:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789185445.537339:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6877:x1876096821767552:12345-0@lo:700: 00000100:00100000:3.0:1789185445.537387:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1876096821767680:0@lo:700: 00000100:00100000:3.0:1789185445.537461:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185445.537492:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7929b2d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789185445.537708:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821767680 00000100:00100000:2.0:1789185445.537715:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821767680 00000100:00100000:2.0:1789185445.537754:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185445.537762:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1876096821767680:12345-0@lo:700: 40000000:02000000:2.0:1789185445.563351:0:5829:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1789185445.574544:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1876096821767680:12345-0@lo:700: Request processed in 36773us (37073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185445.574559:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789185445.574762:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7936dc1880 x1876096821767680/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789185461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185445.574778:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1876096821767680:0@lo:700: 40000000:02000000:0.0:1789185445.574792:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1789185445.727651:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1789185445.727667:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789185445.727827:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6877:x1876096821767552:12345-0@lo:700: Request processed in 190488us (192012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185445.727856:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789185445.728243:0:6877:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7936db8000 x1876096821767552/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789185461 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185445.728256:0:6877:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789185445.728274:0:6877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6877:1876096821767552:0@lo:700: 00000004:02000040:0.0:1789185445.847708:0:6877:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1789185445.857075:0:6877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6877:1876096821767808:0@lo:5: 00000100:00100000:1.0:1789185445.857161:0:6877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185445.857253:0:6877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906bef900 going to sleep for 11 seconds 00000100:00100000:2.0:1789185445.857522:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821767808 00000100:00100000:2.0:1789185445.857532:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821767808 00000100:00100000:2.0:1789185445.857583:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789185445.857593:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6877:x1876096821767808:12345-0@lo:5: 00002000:00080000:3.0:1789185445.873355:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789185445.873378:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1789185445.887980:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6877:x1876096821767808:12345-0@lo:5: Request processed in 30379us (30808us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789185445.887996:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789185445.892141:0:6877:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7936dbe680 x1876096821767808/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185461 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185445.892164:0:6877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6877:1876096821767808:0@lo:5: 00000004:00080000:2.0:1789185445.892192:0:6877:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1789185446.031641:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185447.057029:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185448.080570:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789185448.785287:0:7048:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789185449.103550:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185450.134477:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185450.895886:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821768320:0@lo:400: 00000100:00100000:0.0:1789185450.895959:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185450.896022:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185450.896027:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821767936:0@lo:400: 00000100:00100000:0.0:1789185450.896081:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185450.896106:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821768192:0@lo:400: 00000100:00100000:0.0:1789185450.896132:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185450.896163:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185450.896170:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821768064:0@lo:400: 00000100:00100000:0.0:1789185450.896191:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185450.896235:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821768320 00000100:00100000:0.0:1789185450.896244:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821768320 00000100:00100000:0.0:1789185450.896315:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185450.896325:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1876096821768320:12345-0@lo:400: 00000100:00100000:0.0:1789185450.896385:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1876096821768320:12345-0@lo:400: Request processed in 60us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185450.896399:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185450.896471:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821768192 00000100:00100000:0.0:1789185450.896476:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821768192 00000100:00100000:0.0:1789185450.896505:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821768064 00000100:00100000:0.0:1789185450.896507:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821768064 00000100:00100000:0.0:1789185450.896520:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185450.896526:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821768192:12345-0@lo:400: 00000100:00100000:0.0:1789185450.896563:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821768192:12345-0@lo:400: Request processed in 37us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185450.896569:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185450.896581:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789185450.896588:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821768064:12345-0@lo:400: 00000100:00100000:0.0:1789185450.896612:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821768064:12345-0@lo:400: Request processed in 26us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185450.896617:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789185450.896636:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185450.896641:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789185450.896667:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7906614380 x1876096821768064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185450.896682:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821768064:0@lo:400: 00010000:00080000:0.0:1789185450.896692:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7906616680 x1876096821768192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185450.896699:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821768192:0@lo:400: 00010000:00080000:0.0:1789185450.896729:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7906616d80 x1876096821768320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185450.896738:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821768320:0@lo:400: 00000100:00100000:1.0:1789185450.896990:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821767936 00000100:00100000:1.0:1789185450.896996:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821767936 00000100:00100000:1.0:1789185450.897035:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789185450.897041:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+16:3278:x1876096821767936:12345-0@lo:400: 00000100:00100000:1.0:1789185450.897082:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+16:3278:x1876096821767936:12345-0@lo:400: Request processed in 41us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185450.897087:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789185450.897122:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821767936:0@lo:400: 00000100:00100000:1.0:1789185450.901017:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821768448:0@lo:13: 00000100:00100000:1.0:1789185450.901083:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185450.901165:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821768448 00000100:00100000:1.0:1789185450.901174:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821768448 00000100:00100000:1.0:1789185450.901238:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789185450.901249:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1876096821768448:12345-0@lo:13: 00002000:00000024:1.0:1789185450.901287:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185450.901336:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1876096821768448:12345-0@lo:13: Request processed in 88us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185450.901342:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789185450.901388:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7936dbf800 x1876096821768448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185450.901608:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821768448:0@lo:13: 00000001:00080000:3.0:1789185450.968648:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1789185451.153121:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185452.177046:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185453.199714:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185454.223638:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185455.249686:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185456.015878:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821768704:0@lo:400: 00000100:00100000:2.0:1789185456.015956:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185456.016028:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185456.016034:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821768576:0@lo:400: 00000100:00100000:2.0:1789185456.016067:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185456.016163:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821768704 00000100:00100000:0.0:1789185456.016172:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821768704 00000100:00100000:0.0:1789185456.016229:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789185456.016238:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821768704:12345-0@lo:400: 00000100:00100000:0.0:1789185456.016294:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821768704:12345-0@lo:400: Request processed in 57us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185456.016301:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185456.016585:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821768832:0@lo:400: 00000100:00100000:1.0:1789185456.016624:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185456.016649:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185456.016654:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821768960:0@lo:400: 00000100:00100000:1.0:1789185456.016677:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185456.016708:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821768576 00000100:00100000:1.0:1789185456.016712:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821768576 00000100:00100000:2.0:1789185456.016814:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821768832 00000100:00100000:2.0:1789185456.016819:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821768832 00000100:00100000:2.0:1789185456.016858:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789185456.016868:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821768832:12345-0@lo:400: 00000100:00100000:2.0:1789185456.016928:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821768832:12345-0@lo:400: Request processed in 62us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185456.016935:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789185456.016955:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789185456.016986:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7906614380 x1876096821768832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185456.017001:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821768832:0@lo:400: 00010000:00080000:2.0:1789185456.017035:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7906616680 x1876096821768704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185456.017044:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821768704:0@lo:400: 00000100:00100000:2.0:1789185456.017140:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821769088:0@lo:13: 00000100:00100000:2.0:1789185456.017166:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185456.017201:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821769088 00000100:00100000:2.0:1789185456.017206:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821769088 00000100:00100000:2.0:1789185456.017238:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185456.017245:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821769088:12345-0@lo:13: 00002000:00000024:2.0:1789185456.017275:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185456.017312:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821769088:12345-0@lo:13: Request processed in 68us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185456.017318:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789185456.017331:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789185456.017346:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7936db9180 x1876096821769088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185456.017353:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789185456.017367:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821769088:0@lo:13: 00000100:00100000:2.0:1789185456.017456:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821768960 00000100:00100000:2.0:1789185456.017460:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821768960 00000100:00100000:2.0:1789185456.017484:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789185456.017491:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821768960:12345-0@lo:400: 00000100:00100000:2.0:1789185456.017524:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821768960:12345-0@lo:400: Request processed in 33us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185456.017530:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789185456.017565:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7906615880 x1876096821768960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185456.017574:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821768960:0@lo:400: 00000100:00100000:1.0:1789185456.020465:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789185456.020483:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+16:3281:x1876096821768576:12345-0@lo:400: 00000100:00100000:1.0:1789185456.020590:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+16:3281:x1876096821768576:12345-0@lo:400: Request processed in 114us (4522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185456.020598:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789185456.021061:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821768576:0@lo:400: 00010000:00010000:1.0:1789185456.274132:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185457.298522:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185458.325097:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185459.346821:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185460.367599:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789185460.894379:0:7618:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789185460.894383:0:7618:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789185460.894563:0:7618:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c793f2ba800 00000020:01000004:1.0:1789185460.894582:0:7618:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789185460.894595:0:7618:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789185460.894608:0:7618:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c7907234d40) 00000020:00000080:1.0:1789185460.894623:0:7618:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789185460.912528:0:7618:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789185460.914090:0:7618:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789185460.955320:0:7618:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789185460.964532:0:7618:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789185460.964568:0:7618:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789185460.964629:0:7618:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789185460.964656:0:7618:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789185460.967251:0:7618:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789185460.967265:0:7618:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789185460.967278:0:7618:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x532743011272b847 00000020:01000004:2.0:1789185460.967287:0:7618:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789185460.967308:0:7618:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789185460.967313:0:7618:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789185460.967318:0:7618:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789185460.967339:0:7618:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789185460.967343:0:7618:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789185461.002543:0:7618:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789185461.002584:0:7618:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.154@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789185461.002588:0:7618:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789185461.002590:0:7618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789185461.002591:0:7618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185461.002593:0:7618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185461.002594:0:7618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185461.002595:0:7618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185461.002597:0:7618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789185461.002598:0:7618:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789185461.002599:0:7618:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789185461.002604:0:7618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185461.002606:0:7618:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789185461.002610:0:7618:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789185461.002612:0:7618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789185461.002613:0:7618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789185461.002614:0:7618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185461.002615:0:7618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185461.002616:0:7618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185461.002617:0:7618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185461.002618:0:7618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789185461.002619:0:7618:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789185461.002620:0:7618:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789185461.002621:0:7618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185461.002622:0:7618:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789185461.002659:0:7618:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789185461.002755:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821769216:0@lo:253: 00000100:00100000:3.0:1789185461.002834:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185461.002944:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907e73600 going to sleep for 11 seconds 00000100:00100000:0.0:1789185461.003339:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821769216 00000100:00100000:0.0:1789185461.003349:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821769216 00000100:00100000:0.0:1789185461.003442:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789185461.003453:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+16:7618:x1876096821769216:12345-0@lo:253: 20000000:01000000:0.0:1789185461.003484:0:5815:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789185461.003489:0:5815:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789185461.003493:0:5815:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789185461.003497:0:5815:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789185461.004550:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789185461.004760:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789185461.004773:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789185461.004813:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789185461.004821:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789185461.004852:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789185461.004904:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789185461.005251:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789185461.005270:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.154@tcp 20000000:01000000:0.0:1789185461.005272:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.154@tcp (null) (null) (null) 00000040:00080000:0.0:1789185461.005308:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789185461.005316:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789185461.005375:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789185461.005384:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.154@tcp (null) (null) 00000040:00080000:0.0:1789185461.005460:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789185461.005469:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789185461.005499:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789185461.005552:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789185461.006273:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1789185461.006294:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.154@tcp 20000000:01000000:0.0:1789185461.006296:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.154@tcp (null) (null) (null) 00000040:00080000:0.0:1789185461.006330:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1789185461.006337:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789185461.006362:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1789185461.006369:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.154@tcp (null) (null) 00000040:00080000:0.0:1789185461.006391:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1789185461.006400:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789185461.006476:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1789185461.006506:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1789185461.006520:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1789185461.006524:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1789185461.006529:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789185461.006530:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789185461.006533:0:5815:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789185461.006544:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789185461.006547:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789185461.006577:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789185461.006580:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789185461.011231:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789185461.011326:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789185461.011399:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789185461.012022:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789185461.012082:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789185461.012142:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789185461.012157:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789185461.012159:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789185461.012736:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789185461.013125:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789185461.013162:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789185461.013217:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1789185461.013228:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789185461.013230:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789185461.014018:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1789185461.014110:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1789185461.014147:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1789185461.014475:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1789185461.014518:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789185461.014574:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1789185461.014599:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789185461.014601:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789185461.015876:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1789185461.015950:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1789185461.016013:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789185461.017672:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789185461.017751:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789185461.017791:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:0.0:1789185461.017812:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789185461.017835:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7900031a00/0x532743011272b84e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.017854:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7900030800/0x532743011272b79f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b798 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.017862:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79013ed000/0x532743011272b7c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b7c2 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.017869:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7900030200/0x532743011272b7f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b7ec expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.017875:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79234d7800/0x532743011272b80f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b808 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.017881:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79013ed800/0x532743011272b832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b82b expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.017888:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7900031a00/0x532743011272b84e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.017929:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79013ed800/0x532743011272b832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b82b expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.017946:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c79013ed800/0x532743011272b832 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b82b expref: 16 pid: 5815 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185461.017978:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821769344:0@lo:104: 00000100:00100000:0.0:1789185461.018059:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185461.018112:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79234d7800/0x532743011272b80f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b808 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.018120:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c79234d7800/0x532743011272b80f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b808 expref: 16 pid: 5815 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185461.018127:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906617800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821769472:0@lo:104: 00010000:00010000:0.0:1789185461.018151:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7900030200/0x532743011272b7f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b7ec expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.018158:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7900030200/0x532743011272b7f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b7ec expref: 16 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185461.018166:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906614000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821769600:0@lo:104: 00010000:00010000:0.0:1789185461.018188:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79013ed000/0x532743011272b7c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b7c2 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.018195:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c79013ed000/0x532743011272b7c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b7c2 expref: 16 pid: 5816 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185461.018201:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821769728:0@lo:104: 00010000:00010000:0.0:1789185461.018222:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7900030800/0x532743011272b79f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b798 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.018229:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7900030800/0x532743011272b79f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b798 expref: 16 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185461.018247:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821769856:0@lo:104: 00000100:00100000:0.0:1789185461.018265:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79309400c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185461.018338:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789185461.018355:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185461.018379:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185461.018386:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185461.018394:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185461.018428:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821769344 00000100:00100000:3.0:1789185461.018435:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821769344 00000100:00100000:3.0:1789185461.018467:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821769472 00000100:00100000:3.0:1789185461.018470:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821769472 00000100:00100000:3.0:1789185461.018478:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821769600 00000100:00100000:3.0:1789185461.018480:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821769600 00000100:00100000:3.0:1789185461.018487:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821769728 00000100:00100000:3.0:1789185461.018489:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821769728 00000100:00100000:3.0:1789185461.018496:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821769856 00000100:00100000:3.0:1789185461.018497:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821769856 00000100:00100000:3.0:1789185461.018507:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789185461.018515:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79107e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+7:5815:x1876096821769344:12345-0@lo:104: 00010000:00010000:3.0:1789185461.018532:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272b82b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b832 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.018584:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789185461.018591:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79107e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+7:5815:x1876096821769344:12345-0@lo:104: Request processed in 76us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185461.018597:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789185461.018637:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789185461.018643:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+6:5815:x1876096821769472:12345-0@lo:104: 00010000:00010000:3.0:1789185461.018651:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b80f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.018679:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789185461.018683:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+6:5815:x1876096821769472:12345-0@lo:104: Request processed in 42us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185461.018689:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789185461.018699:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789185461.018704:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+5:5815:x1876096821769600:12345-0@lo:104: 00010000:00010000:3.0:1789185461.018710:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b7ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b7f3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.018731:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789185461.018735:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+5:5815:x1876096821769600:12345-0@lo:104: Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185461.018740:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789185461.018751:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789185461.018756:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+4:5815:x1876096821769728:12345-0@lo:104: 00010000:00010000:3.0:1789185461.018768:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b7c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.018793:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789185461.018798:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+4:5815:x1876096821769728:12345-0@lo:104: Request processed in 42us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185461.018804:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789185461.018816:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185461.018822:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:5815:x1876096821769856:12345-0@lo:104: 00010000:00010000:3.0:1789185461.018830:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b79f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.018852:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789185461.018856:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:5815:x1876096821769856:12345-0@lo:104: Request processed in 35us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185461.018861:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789185461.018928:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789185461.018934:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272b82b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b832 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.018941:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ece00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:1.0:1789185461.018945:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272b82b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b832 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.018954:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272b82b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b832 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185461.018961:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272b82b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b832 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185461.018968:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789185461.019003:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272b82b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b832 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019015:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789185461.019034:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272b82b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b832 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019052:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272b82b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b832 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019068:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789185461.019071:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b80f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019076:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7900031c00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:1.0:1789185461.019079:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b80f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019085:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b80f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185461.019090:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b80f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185461.019095:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789185461.019107:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b80f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019112:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789185461.019124:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b808 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b80f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019130:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7900031c00/0x532743011272b808 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b80f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019148:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789185461.019151:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b7ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b7f3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019156:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013edc00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:1.0:1789185461.019158:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b7ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b7f3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019164:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b7ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b7f3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185461.019169:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b7ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b7f3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185461.019173:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789185461.019185:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b7ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b7f3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019191:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789185461.019195:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b7ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b7f3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019200:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79013edc00/0x532743011272b7ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b7f3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019209:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789185461.019211:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b7c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019225:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7901520800 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:1.0:1789185461.019227:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b7c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019233:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b7c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185461.019238:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b7c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185461.019242:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789185461.019253:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b7c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b7c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019259:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789185461.019264:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b7c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b7c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019270:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b7c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b7c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019281:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185461.019284:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b79f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019289:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6400 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:1.0:1789185461.019291:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b79f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019306:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b79f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185461.019312:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b79f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185461.019316:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789185461.019330:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b798 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b79f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019334:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789185461.019339:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b798 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b79f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019345:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b798 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b79f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019359:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185461.019361:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185461.019362:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185461.019376:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821769984:0@lo:103: 00000100:00100000:1.0:1789185461.019432:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185461.019463:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821770496:0@lo:103: 00000100:00100000:1.0:1789185461.019483:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185461.019503:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185461.019508:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821770368:0@lo:103: 00000100:00100000:1.0:1789185461.019525:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185461.019555:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821770112:0@lo:103: 00000100:00100000:1.0:1789185461.019583:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185461.019601:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185461.019606:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821770240:0@lo:103: 00000100:00100000:1.0:1789185461.019645:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185461.019676:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821769984 00000100:00100000:1.0:1789185461.019680:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821769984 00010000:00010000:1.0:1789185461.019703:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79013ed800/0x532743011272b832 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b82b expref: 17 pid: 5815 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185461.019717:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821770496 00000100:00100000:1.0:1789185461.019720:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821770496 00010000:00010000:1.0:1789185461.019728:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7900030800/0x532743011272b79f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b798 expref: 18 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185461.019737:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821770368 00000100:00100000:1.0:1789185461.019739:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821770368 00010000:00010000:1.0:1789185461.019748:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79013ed000/0x532743011272b7c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b7c2 expref: 19 pid: 5816 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185461.019756:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821770112 00000100:00100000:1.0:1789185461.019758:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821770112 00010000:00010000:1.0:1789185461.019765:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79234d7800/0x532743011272b80f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b808 expref: 20 pid: 5815 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185461.019773:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821770240 00000100:00100000:1.0:1789185461.019775:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821770240 00010000:00010000:1.0:1789185461.019784:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7900030200/0x532743011272b7f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b7ec expref: 21 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185461.019795:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789185461.019801:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+21:3281:x1876096821769984:12345-0@lo:103: 00010000:00010000:1.0:1789185461.019820:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185461.019826:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79013ed800/0x532743011272b832 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b82b expref: 21 pid: 5815 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019839:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79013ed800/0x532743011272b832 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b82b expref: 21 pid: 5815 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019854:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185461.019882:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+21:3281:x1876096821769984:12345-0@lo:103: Request processed in 81us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185461.019888:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789185461.019902:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185461.019907:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+20:3281:x1876096821770496:12345-0@lo:103: 00010000:00010000:1.0:1789185461.019913:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185461.019917:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7900030800/0x532743011272b79f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b798 expref: 20 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019925:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7900030800/0x532743011272b79f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b798 expref: 20 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.019933:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185461.019952:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+20:3281:x1876096821770496:12345-0@lo:103: Request processed in 45us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185461.019958:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185461.019969:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789185461.019975:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821770368:12345-0@lo:103: 00010000:00010000:1.0:1789185461.019983:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185461.019987:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79013ed000/0x532743011272b7c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b7c2 expref: 19 pid: 5816 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020000:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79013ed000/0x532743011272b7c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b7c2 expref: 19 pid: 5816 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020010:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185461.020031:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821770368:12345-0@lo:103: Request processed in 56us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185461.020037:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789185461.020063:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789185461.020070:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:3278:x1876096821770112:12345-0@lo:103: 00010000:00010000:1.0:1789185461.020085:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185461.020090:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79234d7800/0x532743011272b80f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b808 expref: 18 pid: 5815 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020098:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79234d7800/0x532743011272b80f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b808 expref: 18 pid: 5815 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020107:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185461.020133:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:3278:x1876096821770112:12345-0@lo:103: Request processed in 64us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185461.020138:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789185461.020149:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789185461.020155:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:3278:x1876096821770240:12345-0@lo:103: 00010000:00010000:1.0:1789185461.020160:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185461.020164:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7900030200/0x532743011272b7f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b7ec expref: 17 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020173:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7900030200/0x532743011272b7f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b7ec expref: 17 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020188:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7900031a00/0x532743011272b84e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020196:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7900031a00/0x532743011272b84e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020210:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7900031a00/0x532743011272b84e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020218:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7900031a00/0x532743011272b84e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020225:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7900031a00/0x532743011272b84e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020231:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7900031a00/0x532743011272b84e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020236:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7900031a00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185461.020240:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7900031a00/0x532743011272b84e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020248:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7900031a00/0x532743011272b84e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020255:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7900031a00/0x532743011272b84e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020264:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185461.020284:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:3278:x1876096821770240:12345-0@lo:103: Request processed in 130us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185461.020298:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789185461.020342:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821770240:0@lo:103: 00000100:00100000:1.0:1789185461.020351:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821770112:0@lo:103: 00000100:00100000:1.0:1789185461.020376:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821770368:0@lo:103: 00000100:00100000:1.0:1789185461.020383:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821769984:0@lo:103: 00000100:00100000:1.0:1789185461.020389:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821770496:0@lo:103: 00010000:00010000:1.0:1789185461.020435:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79013ed800/0x532743011272b832 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b82b expref: 16 pid: 5815 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185461.020446:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821769344:0@lo:104: 00010000:00010000:1.0:1789185461.020455:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d7800/0x532743011272b80f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b808 expref: 15 pid: 5815 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185461.020462:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906617800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821769472:0@lo:104: 00010000:00010000:1.0:1789185461.020470:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7900030200/0x532743011272b7f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b7ec expref: 14 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185461.020477:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906614000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821769600:0@lo:104: 00010000:00010000:1.0:1789185461.020484:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79013ed000/0x532743011272b7c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b7c2 expref: 13 pid: 5816 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185461.020492:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821769728:0@lo:104: 00010000:00010000:1.0:1789185461.020499:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7900030800/0x532743011272b79f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b798 expref: 12 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185461.020518:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1876096821769856:0@lo:104: 00010000:00010000:1.0:1789185461.020537:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7900031a00/0x532743011272b84e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020545:0:5815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7900031a00/0x532743011272b84e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020551:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7900031a00/0x532743011272b84e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.020556:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7900031a00/0x532743011272b84e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789185461.020569:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1789185461.021158:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185461.090008:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+11:7618:x1876096821769216:12345-0@lo:253: Request processed in 86545us (87161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185461.090025:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789185461.090146:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821769216:0@lo:253: 10000000:01000000:3.0:1789185461.090163:0:7618:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789185461.090167:0:7618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789185461.090169:0:7618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789185461.090171:0:7618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185461.090172:0:7618:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789185461.090173:0:7618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185461.090174:0:7618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185461.090176:0:7618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789185461.090177:0:7618:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789185461.090179:0:7618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185461.090180:0:7618:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789185461.090203:0:7618:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c793f2ba800 from lustre-OST0001 10000000:01000000:3.0:1789185461.090228:0:7618:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789185461.090244:0:7618:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789185461.090252:0:7618:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c7907233380 local copy 10000000:01000000:3.0:1789185461.090257:0:7618:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789185461.090294:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901520400/0x532743011272b855 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.090306:0:7618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.154@tcp lock: ffff9c7901520400/0x532743011272b855 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.090315:0:7618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7901520400/0x532743011272b855 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185461.090332:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821770624:0@lo:101: 00000100:00100000:3.0:1789185461.090370:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185461.090504:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821770624 00000100:00100000:0.0:1789185461.090511:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821770624 00000100:00100000:0.0:1789185461.090562:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789185461.090571:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+11:7618:x1876096821770624:12345-0@lo:101: 00010000:00010000:0.0:1789185461.090584:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185461.090596:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7900030000/0x532743011272b85c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b855 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.090619:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7900030000/0x532743011272b85c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b855 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.090628:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7900030000/0x532743011272b85c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b855 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.090637:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7900030000, rc 0) 00000100:00100000:0.0:1789185461.090663:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+12:7618:x1876096821770624:12345-0@lo:101: Request processed in 94us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185461.090669:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789185461.090853:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905bd6840 going to sleep for 11 seconds 00000100:00100000:3.0:1789185461.090868:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821770624:0@lo:101: 00010000:00010000:3.0:1789185461.090882:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7901520400/0x532743011272b855 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x532743011272b85c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.090890:0:7618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7901520400/0x532743011272b855 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x532743011272b85c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185461.090986:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821770752:0@lo:501: 00000100:00100000:3.0:1789185461.091011:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185461.091038:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905bd6840 going to sleep for 11 seconds 00000100:00100000:2.0:1789185461.091113:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821770752 00000100:00100000:2.0:1789185461.091118:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821770752 00000100:00100000:2.0:1789185461.091151:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789185461.091158:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:7618:x1876096821770752:12345-0@lo:501: 00000100:00100000:2.0:1789185461.091391:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:7618:x1876096821770752:12345-0@lo:501: Request processed in 233us (378us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789185461.091399:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789185461.091537:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821770752:0@lo:501: 10000000:01000000:3.0:1789185461.091547:0:7618:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789185461.091572:0:7618:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789185461.091579:0:7618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901520400/0x532743011272b855 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x532743011272b85c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.091594:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901520400/0x532743011272b855 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x532743011272b85c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.091601:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9c7901520400/0x532743011272b855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x532743011272b85c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.091624:0:7618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789185461.091642:0:7618:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c793f2ba800 10000000:01000000:3.0:1789185461.091646:0:7618:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789185461.091650:0:7618:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789185461.091653:0:7618:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789185461.091656:0:7618:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789185461.091659:0:7618:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789185461.091675:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.091681:0:7618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.091689:0:7618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185461.091699:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821770880:0@lo:101: 00000100:00100000:3.0:1789185461.091721:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185461.091829:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185461.091836:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7901520400/0x532743011272b855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x532743011272b85c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.091842:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7901520400 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:0.0:1789185461.091846:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7901520400/0x532743011272b855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x532743011272b85c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.091865:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7901520400/0x532743011272b855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x532743011272b85c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185461.091872:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7901520400/0x532743011272b855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x532743011272b85c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185461.091878:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185461.091896:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7901520400/0x532743011272b855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x532743011272b85c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.091902:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185461.091920:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7901520400/0x532743011272b855 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x532743011272b85c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.091926:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7901520400/0x532743011272b855 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x532743011272b85c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.091938:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185461.091940:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185461.091941:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185461.091951:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821771008:0@lo:103: 00000100:00100000:0.0:1789185461.091977:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185461.092021:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821771008 00000100:00100000:0.0:1789185461.092025:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821771008 00000100:00100000:0.0:1789185461.092071:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789185461.092078:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:3278:x1876096821771008:12345-0@lo:103: 00010000:00010000:0.0:1789185461.092088:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185461.092100:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7900030000/0x532743011272b85c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x532743011272b855 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.092119:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185461.092147:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:3278:x1876096821771008:12345-0@lo:103: Request processed in 69us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185461.092153:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789185461.092183:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821771008:0@lo:103: 00000100:00100000:3.0:1789185461.092262:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905bd6540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185461.092363:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821770880 00000100:00100000:2.0:1789185461.092368:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821770880 00000100:00100000:2.0:1789185461.092555:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789185461.092564:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+11:7618:x1876096821770880:12345-0@lo:101: 00010000:00010000:2.0:1789185461.092574:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185461.092586:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d6e00/0x532743011272b86a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b863 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185461.092605:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d6e00/0x532743011272b86a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b863 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185461.092615:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d6e00/0x532743011272b86a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b863 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185461.092621:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6e00, rc 0) 00000100:00100000:2.0:1789185461.092703:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:7618:x1876096821770880:12345-0@lo:101: Request processed in 141us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185461.092710:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789185461.092856:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821770880:0@lo:101: 00010000:00010000:3.0:1789185461.092869:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b86a expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.092890:0:7618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b86a expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185461.092973:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821771136:0@lo:501: 00000100:00100000:3.0:1789185461.093015:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185461.093087:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905bd6540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185461.093124:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821771136 00000100:00100000:2.0:1789185461.093134:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821771136 00000100:00100000:2.0:1789185461.093196:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789185461.093204:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:7618:x1876096821771136:12345-0@lo:501: 00000100:00100000:2.0:1789185461.093434:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+12:7618:x1876096821771136:12345-0@lo:501: Request processed in 230us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185461.093440:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789185461.093501:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821771136:0@lo:501: 00000100:00100000:3.0:1789185461.093526:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821771264:0@lo:503: 00000100:00100000:3.0:1789185461.093564:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185461.093665:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905bd6540 going to sleep for 11 seconds 00000100:00100000:1.0:1789185461.093817:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821771264 00000100:00100000:1.0:1789185461.093822:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821771264 00000100:00100000:1.0:1789185461.093850:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789185461.093857:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:7618:x1876096821771264:12345-0@lo:503: 00000100:00100000:1.0:1789185461.094020:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:7618:x1876096821771264:12345-0@lo:503: Request processed in 163us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185461.094026:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789185461.094122:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821771264:0@lo:503: 00000040:00080000:3.0:1789185461.094400:0:7618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789185461.094475:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821771392:0@lo:502: 00000100:00100000:3.0:1789185461.094510:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185461.094535:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905bd6540 going to sleep for 11 seconds 00000100:00100000:1.0:1789185461.094592:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821771392 00000100:00100000:1.0:1789185461.094596:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821771392 00000100:00100000:1.0:1789185461.094616:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789185461.094621:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:7618:x1876096821771392:12345-0@lo:502: 00000100:00100000:1.0:1789185461.094837:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:7618:x1876096821771392:12345-0@lo:502: Request processed in 215us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185461.094852:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789185461.094929:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821771392:0@lo:502: 00000040:00080000:3.0:1789185461.095225:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789185461.095280:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789185461.095316:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789185461.095366:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789185461.095438:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789185461.095478:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789185461.095500:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821771520:0@lo:502: 00000100:00100000:3.0:1789185461.095537:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185461.095558:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905bd6540 going to sleep for 11 seconds 00000100:00100000:1.0:1789185461.095628:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821771520 00000100:00100000:1.0:1789185461.095633:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821771520 00000100:00100000:1.0:1789185461.095656:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789185461.095663:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:7618:x1876096821771520:12345-0@lo:502: 00000100:00100000:1.0:1789185461.095931:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:7618:x1876096821771520:12345-0@lo:502: Request processed in 268us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185461.095939:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789185461.096217:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821771520:0@lo:502: 00000040:00080000:1.0:1789185461.096383:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789185461.096394:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1789185461.097062:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789185461.097071:0:7624:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789185461.097078:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185461.097080:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789185461.097085:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789185461.097101:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c792f8019c0) 00000020:00000080:2.0:1789185461.097123:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789185461.097129:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789185461.097189:0:7624:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c793f2ba800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789185461.097198:0:7624:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789185461.097205:0:7624:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x532743011272b878 00010000:00010000:1.0:1789185461.103893:0:7624:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1789185461.104286:0:7624:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789185461.107021:0:7624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789185461.107329:0:7624:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789185461.115669:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789185461.116899:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789185461.118382:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789185461.118396:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185461.118402:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185461.118437:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789185461.118442:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185461.118448:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185461.118449:0:7624:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789185461.118452:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789185461.118454:0:7624:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789185461.118513:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185461.118517:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185461.118519:0:7624:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789185461.118522:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789185461.118667:0:7618:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789185461.118711:0:7618:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789185461.118863:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b863 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b86a expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.118877:0:7618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b86a expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185461.118886:0:7618:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c793f2ba800 from 1 10000000:01000000:3.0:1789185461.118890:0:7618:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185461.118930:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901521c00/0x532743011272b87f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.118939:0:7618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7901521c00/0x532743011272b87f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.118950:0:7618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7901521c00/0x532743011272b87f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185461.118974:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821771648:0@lo:101: 00000100:00100000:3.0:1789185461.119060:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185461.119100:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905bd6540 going to sleep for 11 seconds 00000100:00100000:3.0:1789185461.119127:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821771648 00000100:00100000:3.0:1789185461.119133:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821771648 00000100:00100000:3.0:1789185461.119173:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789185461.119181:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:7618:x1876096821771648:12345-0@lo:101: 00010000:00010000:3.0:1789185461.119195:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185461.119208:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7901520400/0x532743011272b886 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b87f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.119243:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7901520400/0x532743011272b886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b87f expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.119255:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7901520400/0x532743011272b886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b87f expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.119264:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7901520400, rc 0) 00000100:00100000:3.0:1789185461.119300:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+13:7618:x1876096821771648:12345-0@lo:101: Request processed in 119us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185461.119306:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789185461.119357:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821771648:0@lo:101: 00010000:00010000:3.0:1789185461.119371:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7901521c00/0x532743011272b87f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b886 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.119380:0:7618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7901521c00/0x532743011272b87f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b886 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185461.119498:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821771776:0@lo:501: 00000100:00100000:3.0:1789185461.119525:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185461.119538:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905bd6540 going to sleep for 11 seconds 00000100:00100000:3.0:1789185461.119899:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821771776 00000100:00100000:3.0:1789185461.119904:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821771776 00000100:00100000:3.0:1789185461.119941:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789185461.119949:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:7618:x1876096821771776:12345-0@lo:501: 00000100:00100000:3.0:1789185461.120220:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:7618:x1876096821771776:12345-0@lo:501: Request processed in 271us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185461.120227:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789185461.120273:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821771776:0@lo:501: 00000100:00100000:3.0:1789185461.120302:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821771904:0@lo:503: 00000100:00100000:3.0:1789185461.120339:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185461.120360:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905bd6540 going to sleep for 11 seconds 00000100:00100000:3.0:1789185461.120374:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821771904 00000100:00100000:3.0:1789185461.120377:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821771904 00000100:00100000:3.0:1789185461.120400:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789185461.120430:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:7618:x1876096821771904:12345-0@lo:503: 00000100:00100000:3.0:1789185461.123541:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:7618:x1876096821771904:12345-0@lo:503: Request processed in 3125us (3191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185461.123556:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789185461.124333:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821771904:0@lo:503: 00000040:00080000:2.0:1789185461.124708:0:7618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789185461.124863:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821772032:0@lo:502: 00000100:00100000:2.0:1789185461.124919:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185461.125019:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7940bdb840 going to sleep for 11 seconds 00000100:00100000:3.0:1789185461.129590:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821772032 00000100:00100000:3.0:1789185461.129607:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821772032 00000100:00100000:3.0:1789185461.129675:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789185461.129697:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+13:7618:x1876096821772032:12345-0@lo:502: 00000100:00100000:3.0:1789185461.130019:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+13:7618:x1876096821772032:12345-0@lo:502: Request processed in 324us (5098us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185461.130027:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789185461.130115:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821772032:0@lo:502: 00000040:00080000:3.0:1789185461.130431:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789185461.130486:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789185461.130519:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821772160:0@lo:502: 00000100:00100000:3.0:1789185461.130560:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185461.130588:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907093840 going to sleep for 11 seconds 00000100:00100000:3.0:1789185461.130601:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821772160 00000100:00100000:3.0:1789185461.130605:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821772160 00000100:00100000:3.0:1789185461.130630:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789185461.130644:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:7618:x1876096821772160:12345-0@lo:502: 00000100:00100000:3.0:1789185461.130769:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:7618:x1876096821772160:12345-0@lo:502: Request processed in 125us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185461.130776:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789185461.130817:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821772160:0@lo:502: 00000040:00080000:3.0:1789185461.130889:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789185461.130898:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789185461.134030:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185461.134060:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185461.134063:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789185461.134070:0:7628:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c793f2ba800 00000020:00000080:1.0:1789185461.134073:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789185461.134094:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185461.134097:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185461.134099:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789185461.134102:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789185461.134263:0:7618:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789185461.134286:0:7618:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185461.134335:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901521c00/0x532743011272b87f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b886 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.134347:0:7618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7901521c00/0x532743011272b87f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b886 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185461.134385:0:7618:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789185461.134388:0:7618:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c793f2ba800 10000000:01000000:3.0:1789185461.134391:0:7618:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c793f2ba800 10000000:01000000:3.0:1789185461.134395:0:7618:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789185461.134401:0:7618:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c793f2ba800 from 1 10000000:01000000:3.0:1789185461.134434:0:7618:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789185461.134470:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b88d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.134478:0:7618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b88d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185461.134489:0:7618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b88d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185461.134524:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821772288:0@lo:101: 00000100:00100000:3.0:1789185461.134597:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185461.134639:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79070936c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185461.134903:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821772288 00000100:00100000:0.0:1789185461.134911:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821772288 00000100:00100000:0.0:1789185461.134958:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789185461.134968:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:7618:x1876096821772288:12345-0@lo:101: 00010000:00010000:0.0:1789185461.134983:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185461.134996:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7900030000/0x532743011272b894 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b88d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.135022:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7900030000/0x532743011272b894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b88d expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.135033:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7900030000/0x532743011272b894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b88d expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.135052:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7900030000, rc 0) 00000100:00100000:0.0:1789185461.135102:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+14:7618:x1876096821772288:12345-0@lo:101: Request processed in 135us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185461.135109:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789185461.135194:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821772288:0@lo:101: 00010000:00010000:2.0:1789185461.135211:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b88d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b894 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185461.135221:0:7618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b88d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b894 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185461.135332:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821772416:0@lo:501: 00000100:00100000:2.0:1789185461.135372:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185461.135401:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7940bdb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185461.135491:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821772416 00000100:00100000:0.0:1789185461.135495:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821772416 00000100:00100000:0.0:1789185461.135529:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789185461.135537:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:7618:x1876096821772416:12345-0@lo:501: 00000100:00100000:0.0:1789185461.136351:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:7618:x1876096821772416:12345-0@lo:501: Request processed in 812us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185461.136361:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789185461.136582:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185461.136594:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821772544:0@lo:400: 00000100:00100000:0.0:1789185461.136626:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185461.136656:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821772672:0@lo:400: 00000100:00100000:0.0:1789185461.136688:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185461.136707:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185461.136712:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821772800:0@lo:400: 00000100:00100000:0.0:1789185461.136856:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185461.136895:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821772544 00000100:00100000:0.0:1789185461.136900:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821772544 00000100:00100000:0.0:1789185461.136931:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821772672 00000100:00100000:0.0:1789185461.136934:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821772672 00000100:00100000:0.0:1789185461.136962:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789185461.136970:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821772544:12345-0@lo:400: 00000100:00100000:0.0:1789185461.137011:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821772544:12345-0@lo:400: Request processed in 41us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185461.137018:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789185461.137031:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789185461.137037:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821772672:12345-0@lo:400: 00000100:00100000:0.0:1789185461.137105:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821772672:12345-0@lo:400: Request processed in 68us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185461.137111:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789185461.137134:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789185461.137163:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7906614e00 x1876096821772544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185461.137187:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821772544:0@lo:400: 00010000:00080000:0.0:1789185461.137216:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7906615500 x1876096821772672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185461.137226:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821772672:0@lo:400: 00000100:00100000:3.0:1789185461.137282:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821772800 00000100:00100000:3.0:1789185461.137287:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821772800 00000100:00100000:3.0:1789185461.137332:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185461.137340:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821772800:12345-0@lo:400: 00000100:00100000:3.0:1789185461.137378:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821772800:12345-0@lo:400: Request processed in 40us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185461.137383:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789185461.137440:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7906614000 x1876096821772800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185461.137450:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821772800:0@lo:400: 00000100:00080000:0.0:1789185461.137597:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185461.137967:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821772416:0@lo:501: 00000100:00100000:2.0:1789185461.138010:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821772928:0@lo:503: 00000100:00100000:2.0:1789185461.138071:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185461.138133:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7940bdb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185461.138240:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185461.138249:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821773056:0@lo:13: 00000100:00100000:3.0:1789185461.138279:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185461.138343:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821773056 00000100:00100000:1.0:1789185461.138349:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821773056 00000100:00100000:1.0:1789185461.138390:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789185461.138399:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821773056:12345-0@lo:13: 00002000:00000024:1.0:1789185461.138452:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185461.138493:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821773056:12345-0@lo:13: Request processed in 96us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185461.138499:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789185461.138570:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7936dbea00 x1876096821773056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185461.138585:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821773056:0@lo:13: 00000100:00100000:0.0:1789185461.138863:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821772928 00000100:00100000:0.0:1789185461.138868:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821772928 00000100:00100000:0.0:1789185461.138938:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789185461.138946:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+14:7618:x1876096821772928:12345-0@lo:503: 00000100:00100000:0.0:1789185461.139174:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+14:7618:x1876096821772928:12345-0@lo:503: Request processed in 229us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185461.139181:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789185461.139266:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821772928:0@lo:503: 00000040:00080000:2.0:1789185461.139606:0:7618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789185461.139670:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821773184:0@lo:502: 00000100:00100000:2.0:1789185461.139725:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185461.140124:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7940bdb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185461.140219:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821773184 00000100:00100000:1.0:1789185461.140226:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821773184 00000100:00100000:1.0:1789185461.140256:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789185461.140265:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:7618:x1876096821773184:12345-0@lo:502: 00000100:00100000:1.0:1789185461.140502:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:7618:x1876096821773184:12345-0@lo:502: Request processed in 237us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185461.140510:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789185461.140652:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821773184:0@lo:502: 00000040:00080000:2.0:1789185461.140980:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789185461.141036:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789185461.141091:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789185461.141140:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789185461.141178:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789185461.141256:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789185461.141290:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789185461.141316:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789185461.141360:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789185461.141399:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789185461.141476:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789185461.141527:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789185461.141576:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789185461.141621:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789185461.141663:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789185461.141695:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789185461.141731:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789185461.141780:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789185461.141818:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789185461.141854:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789185461.141919:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789185461.141959:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789185461.141995:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789185461.142056:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789185461.142097:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789185461.142134:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789185461.142183:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789185461.142217:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789185461.142262:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789185461.142305:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789185461.142338:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789185461.142371:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789185461.142427:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789185461.142480:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789185461.142516:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789185461.142584:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789185461.142624:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789185461.142672:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821773312:0@lo:502: 00000100:00100000:2.0:1789185461.142750:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185461.142797:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7940bdb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185461.143108:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821773312 00000100:00100000:1.0:1789185461.143117:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821773312 00000100:00100000:1.0:1789185461.143160:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789185461.143170:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:7618:x1876096821773312:12345-0@lo:502: 00000100:00100000:1.0:1789185461.143390:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:7618:x1876096821773312:12345-0@lo:502: Request processed in 220us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185461.143424:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789185461.143592:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821773312:0@lo:502: 00000040:00080000:2.0:1789185461.143667:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1789185461.143800:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789185461.145476:0:7629:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789185461.145508:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c792fab99c0) 00000020:00000080:1.0:1789185461.145532:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1789185461.145619:0:7629:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c793f2ba800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789185461.145624:0:7629:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c793f2ba800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789185461.145626:0:7629:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c793f2ba800 3 00010000:00080000:1.0:1789185461.145657:0:7629:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c792fae6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.154@tcp at head 00010000:00010000:1.0:1789185461.147592:0:7629:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1789185461.147966:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789185461.148001:0:7629:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789185461.148015:0:7629:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x532743011272b8a2 00000100:00080000:1.0:1789185461.148025:0:7629:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789185461.148037:0:7629:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c792fae6800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:1.0:1789185461.148084:0:7629:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7936dbc700 x1876096821773440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789185461.148154:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1876096821773440:0@lo:38: 00000100:00100000:3.0:1789185461.148226:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185461.148351:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821773440 00000100:00100000:0.0:1789185461.148359:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821773440 00000100:00100000:0.0:1789185461.148401:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789185461.148437:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3277:x1876096821773440:12345-0@lo:38: 00010000:00080000:0.0:1789185461.148461:0:5823:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:0.0:1789185461.148493:0:5823:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x532743011272b8a9 00000004:00100000:0.0:1789185461.148508:0:5823:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789185461.148538:0:5823:0:(import.c:65:import_set_state_nolock()) ffff9c792fb08000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789185461.148616:0:7629:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789185461.154997:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876096821773440:12345-0@lo:38: Request processed in 6547us (6757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185461.155014:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:0.0:1789185461.155470:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1789185461.155620:0:7618:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789185461.155659:0:7618:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789185461.155689:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b88d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b894 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185461.155702:0:7618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b88d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b894 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789185461.155826:0:7618:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789185461.155829:0:7618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789185461.155830:0:7618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185461.155832:0:7618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185461.155833:0:7618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185461.155834:0:7618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185461.155836:0:7618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185461.155837:0:7618:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789185461.155839:0:7618:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789185461.155841:0:7618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185461.155842:0:7618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789185461.155846:0:7618:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789185461.155849:0:7618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789185461.155850:0:7618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789185461.155852:0:7618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185461.155853:0:7618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185461.155854:0:7618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185461.155856:0:7618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185461.155857:0:7618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185461.155858:0:7618:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789185461.155859:0:7618:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789185461.155860:0:7618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185461.155861:0:7618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789185461.155889:0:7618:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789185461.155907:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821773568:0@lo:253: 00000100:00100000:2.0:1789185461.155986:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185461.156033:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7940bdb840 going to sleep for 11 seconds 00000100:00080000:2.0:1789185461.156105:0:7631:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9c7936db9180 x1876096821773696/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185461.156124:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7940bdb180 going to sleep for 0 seconds 00010000:00080000:3.0:1789185461.156350:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7936dbc700 x1876096821773440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185461.156361:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789185461.156379:0:3277:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789185461.156390:0:3277:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789185461.156396:0:3277:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789185461.156400:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c792fae6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789185461.156479:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821773568 00000100:00100000:0.0:1789185461.156493:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821773568 00000100:00100000:0.0:1789185461.156537:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789185461.156546:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:7618:x1876096821773568:12345-0@lo:253: 20000000:01000000:0.0:1789185461.156575:0:5816:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789185461.156590:0:5816:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1789185461.157275:0:3277:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000387c5c8b): req@ffff9c7936db9180 x1876096821773696/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185461.157299:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1876096821773440:0@lo:38: 00000100:00100000:0.0:1789185461.158473:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185461.158508:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7940bdb180 going to sleep for 11 seconds 00000100:00100000:1.0:1789185461.160214:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821773696 00000100:00100000:1.0:1789185461.160228:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821773696 00000100:00100000:1.0:1789185461.160297:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185461.160307:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7631:x1876096821773696:12345-0@lo:901: 00000100:00080000:0.0:1789185461.161233:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789185461.161275:0:7631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7936db9180 x1876096821773696/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789185477 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185461.161290:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db9180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7631:1876096821773696:0@lo:901: 00000100:00100000:1.0:1789185461.162871:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7631:x1876096821773696:12345-0@lo:901: Request processed in 2560us (4398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185461.162884:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 20000000:01000000:0.0:1789185461.189781:0:5816:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789185461.189807:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789185461.189865:0:5838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789185461.189873:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789185461.189900:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c79234d6800/0x532743011272b8b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185461.189922:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7901520000/0x532743011272b801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b7fa expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185461.189931:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c79234d6800/0x532743011272b8b0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185461.189981:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7901520000/0x532743011272b801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b7fa expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185461.189999:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7901520000/0x532743011272b801 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b7fa expref: 14 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185461.190015:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbaa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1876096821773824:0@lo:104: 00000100:00100000:2.0:1789185461.190095:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185461.190144:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7940bdb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185461.190150:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821773824 00000100:00100000:0.0:1789185461.190157:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821773824 00000100:00100000:0.0:1789185461.190211:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789185461.190221:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:5838:x1876096821773824:12345-0@lo:104: 00010000:00010000:0.0:1789185461.190234:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c79013ec400/0x532743011272b7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b801 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185461.190297:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789185461.190304:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:5838:x1876096821773824:12345-0@lo:104: Request processed in 85us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185461.190310:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789185461.190312:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbaa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1876096821773824:0@lo:104: 00010000:00010000:2.0:1789185461.190329:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c79234d6800/0x532743011272b8b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191091:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185461.191101:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c79013ec400/0x532743011272b7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b801 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191132:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ec400 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:1.0:1789185461.191136:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c79013ec400/0x532743011272b7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b801 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191147:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79013ec400/0x532743011272b7fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b801 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185461.191156:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79013ec400/0x532743011272b7fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b801 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185461.191162:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789185461.191272:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c79013ec400/0x532743011272b7fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b801 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191280:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789185461.191443:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185461.191464:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821773952:0@lo:103: 00010000:00010000:1.0:1789185461.191465:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c79013ec400/0x532743011272b7fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b801 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191473:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79013ec400/0x532743011272b7fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b801 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191491:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185461.191493:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185461.191494:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185461.191511:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185461.191537:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821773952 00000100:00100000:1.0:1789185461.191543:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821773952 00010000:00010000:1.0:1789185461.191565:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7901520000/0x532743011272b801 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b7fa expref: 15 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185461.191815:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789185461.191831:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791f905c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+15:3278:x1876096821773952:12345-0@lo:103: 00010000:00010000:1.0:1789185461.191843:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185461.191848:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7901520000/0x532743011272b801 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b7fa expref: 15 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191862:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7901520000/0x532743011272b801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b7fa expref: 15 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191877:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7901520000/0x532743011272b801 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b7fa expref: 15 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191890:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c79234d6800/0x532743011272b8b0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191898:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d6800/0x532743011272b8b0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789185461.191913:0:5808:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003407789s 00010000:00010000:1.0:1789185461.191917:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c79234d6800/0x532743011272b8b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191925:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c79234d6800/0x532743011272b8b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191933:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c79234d6800/0x532743011272b8b0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191940:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c79234d6800/0x532743011272b8b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191946:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6800 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185461.191956:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c79234d6800/0x532743011272b8b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191964:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c79234d6800/0x532743011272b8b0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191984:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c79234d6800/0x532743011272b8b0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185461.191995:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185461.192031:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791f905c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+14:3278:x1876096821773952:12345-0@lo:103: Request processed in 202us (519us total) trans 0 rc 0/0 00010000:00010000:2.0:1789185461.192081:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c79234d6800/0x532743011272b8b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185461.192090:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c79234d6800/0x532743011272b8b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185461.192106:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d6800/0x532743011272b8b0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185461.194249:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789185461.194329:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821773952:0@lo:103: 00000100:00100000:0.0:1789185461.208611:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:7618:x1876096821773568:12345-0@lo:253: Request processed in 52055us (52613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185461.208631:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789185461.208784:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ad68fcc-785c-4134-99e9-eee8a8012753:7618:1876096821773568:0@lo:253: 10000000:01000000:2.0:1789185461.208801:0:7618:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789185461.208804:0:7618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789185461.208806:0:7618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789185461.208808:0:7618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185461.208810:0:7618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185461.208811:0:7618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185461.208813:0:7618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185461.208814:0:7618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185461.208816:0:7618:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789185461.208817:0:7618:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789185461.208819:0:7618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185461.208820:0:7618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789185461.208833:0:7618:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789185461.213301:0:7618:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789185461.213602:0:7618:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789185461.213895:0:7618:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789185461.214058:0:7618:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789185461.214251:0:7618:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789185461.214654:0:7618:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789185461.216002:0:7618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1789185461.391835:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789185461.401590:0:7618:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789185461.401598:0:7618:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789185461.401644:0:7618:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789185461.401732:0:7618:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789185461.401747:0:7618:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789185461.401780:0:7618:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789185462.415664:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185463.441313:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185464.463697:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185465.488127:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185466.256449:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821774080:0@lo:13: 00000100:00100000:1.0:1789185466.256568:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185466.256810:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821774080 00000100:00100000:1.0:1789185466.256822:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821774080 00000100:00100000:1.0:1789185466.256965:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789185466.256978:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821774080:12345-0@lo:13: 00002000:00000024:1.0:1789185466.257036:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185466.257529:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821774080:12345-0@lo:13: Request processed in 552us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185466.257545:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789185466.257585:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821774336:0@lo:400: 00000100:00100000:1.0:1789185466.257620:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185466.257653:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185466.257660:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821774464:0@lo:400: 00000100:00100000:1.0:1789185466.257701:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789185466.257735:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185466.258177:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821774336 00000100:00100000:1.0:1789185466.258183:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821774336 00000100:00100000:1.0:1789185466.258224:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821774464 00000100:00100000:1.0:1789185466.258228:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821774464 00000100:00100000:1.0:1789185466.258251:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789185466.258260:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821774336:12345-0@lo:400: 00000100:00100000:1.0:1789185466.258317:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821774336:12345-0@lo:400: Request processed in 58us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185466.258325:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789185466.258339:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789185466.258345:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821774464:12345-0@lo:400: 00000100:00100000:1.0:1789185466.258373:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821774464:12345-0@lo:400: Request processed in 29us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185466.258378:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789185466.258437:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821774208:0@lo:400: 00000100:00100000:1.0:1789185466.258485:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185466.258522:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185466.258528:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821774592:0@lo:400: 00000100:00100000:1.0:1789185466.258615:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789185466.258644:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789185466.258729:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbf480 x1876096821774464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185466.258811:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821774464:0@lo:400: 00010000:00080000:1.0:1789185466.258829:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbce00 x1876096821774336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185466.258853:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821774336:0@lo:400: 00000100:00100000:1.0:1789185466.258883:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821774592 00000100:00100000:1.0:1789185466.258959:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821774592 00000100:00100000:1.0:1789185466.259006:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789185466.259013:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821774592:12345-0@lo:400: 00000100:00100000:1.0:1789185466.259051:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821774592:12345-0@lo:400: Request processed in 39us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185466.259057:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789185466.259160:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789185466.259179:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbd880 x1876096821774592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185466.259188:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821774592:0@lo:400: 00010000:00080000:1.0:1789185466.259225:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbca80 x1876096821774080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185466.259244:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821774080:0@lo:13: 00000100:00100000:3.0:1789185466.264919:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821774208 00000100:00100000:3.0:1789185466.264944:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821774208 00000100:00100000:3.0:1789185466.265033:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789185466.265047:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+13:3281:x1876096821774208:12345-0@lo:400: 00000100:00100000:3.0:1789185466.265176:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+13:3281:x1876096821774208:12345-0@lo:400: Request processed in 132us (6689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185466.265184:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789185466.265195:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821774208:0@lo:400: 00010000:00010000:1.0:1789185466.514328:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185467.539081:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185468.568266:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185469.590745:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789185469.841480:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789185469.841493:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c791f9b0000 from 30 10000000:01000000:0.0:1789185469.841502:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789185469.841568:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7900030800/0x532743011272b8b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.841583:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7900030800/0x532743011272b8b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.841605:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7900030800/0x532743011272b8b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185469.841639:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906614e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821774720:0@lo:101: 00000100:00100000:0.0:1789185469.841745:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185469.841821:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791aed2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185469.842019:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821774720 00000100:00100000:2.0:1789185469.842032:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821774720 00000100:00100000:2.0:1789185469.842103:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789185469.842114:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:5820:x1876096821774720:12345-0@lo:101: 00010000:00010000:2.0:1789185469.842131:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185469.842148:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d6a00/0x532743011272b8be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b8b7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185469.842179:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d6a00/0x532743011272b8be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b8b7 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185469.842191:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d6a00/0x532743011272b8be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b8b7 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185469.842527:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6a00, rc 0) 00000100:00100000:2.0:1789185469.842640:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821774720:12345-0@lo:101: Request processed in 527us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185469.842648:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789185469.852551:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906614e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821774720:0@lo:101: 00010000:00010000:0.0:1789185469.852599:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7900030800/0x532743011272b8b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8be expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.852616:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7900030800/0x532743011272b8b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b8be expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185469.852722:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906614e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821774848:0@lo:501: 00000100:00100000:0.0:1789185469.852818:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185469.852877:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791aed2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185469.853339:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821774848 00000100:00100000:2.0:1789185469.853349:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821774848 00000100:00100000:2.0:1789185469.853436:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789185469.853447:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821774848:12345-0@lo:501: 00000100:00100000:2.0:1789185469.853920:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821774848:12345-0@lo:501: Request processed in 473us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185469.853929:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789185469.854257:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906614e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821774848:0@lo:501: 00000100:00100000:0.0:1789185469.854310:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906614e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821774976:0@lo:503: 00000100:00100000:0.0:1789185469.854368:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185469.854436:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791aed2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185469.854606:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821774976 00000100:00100000:3.0:1789185469.854613:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821774976 00000100:00100000:3.0:1789185469.854662:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789185469.854672:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821774976:12345-0@lo:503: 00000100:00100000:3.0:1789185469.855077:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821774976:12345-0@lo:503: Request processed in 406us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185469.855084:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789185469.855140:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906614e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821774976:0@lo:503: 00000100:00100000:3.0:1789185469.855386:0:7952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7952:1876096821775104:0@lo:502: 00000100:00100000:3.0:1789185469.855487:0:7952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185469.855523:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821775104 00000100:00100000:3.0:1789185469.855528:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821775104 00000100:00100000:3.0:1789185469.855557:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789185469.855566:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+14:7952:x1876096821775104:12345-0@lo:502: 00000100:00100000:3.0:1789185469.855816:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+14:7952:x1876096821775104:12345-0@lo:502: Request processed in 250us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185469.855823:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789185469.855866:0:7952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906537e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185469.855880:0:7952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7952:1876096821775104:0@lo:502: 00000100:00100000:3.0:1789185469.855930:0:7952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7952:1876096821775232:0@lo:502: 00000100:00100000:3.0:1789185469.855975:0:7952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185469.855994:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821775232 00000100:00100000:3.0:1789185469.855998:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821775232 00000100:00100000:3.0:1789185469.856020:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789185469.856027:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+14:7952:x1876096821775232:12345-0@lo:502: 00000100:00100000:3.0:1789185469.856148:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+14:7952:x1876096821775232:12345-0@lo:502: Request processed in 121us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185469.856155:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789185469.856182:0:7952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906537e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185469.856193:0:7952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7952:1876096821775232:0@lo:502: 00000040:00080000:3.0:1789185469.856210:0:7952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789185469.856279:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789185469.856315:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789185469.856327:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7900030800/0x532743011272b8b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8be expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185469.856340:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7900030800/0x532743011272b8b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8be expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185469.856358:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789185469.856361:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789185469.856365:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789185469.856394:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04000/0x532743011272b8c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185469.856435:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c793fe04000/0x532743011272b8c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185469.856446:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c793fe04000/0x532743011272b8c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185469.856459:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821775360:0@lo:101: 00000100:00100000:3.0:1789185469.856487:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185469.856507:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7918d5e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789185469.856518:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821775360 00000100:00100000:3.0:1789185469.856521:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821775360 00000100:00100000:3.0:1789185469.856544:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789185469.856551:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821775360:12345-0@lo:101: 00010000:00010000:3.0:1789185469.856561:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185469.856577:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe05200/0x532743011272b8cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b8c5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185469.856604:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe05200/0x532743011272b8cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b8c5 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185469.856616:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe05200/0x532743011272b8cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b8c5 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185469.856639:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05200, rc 0) 00000100:00100000:3.0:1789185469.856670:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821775360:12345-0@lo:101: Request processed in 119us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185469.856677:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789185469.856709:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821775360:0@lo:101: 00010000:00010000:3.0:1789185469.856724:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c793fe04000/0x532743011272b8c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8cc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185469.856733:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c793fe04000/0x532743011272b8c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b8cc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185469.856776:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821775488:0@lo:501: 00000100:00100000:3.0:1789185469.856800:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185469.856813:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906537180 going to sleep for 11 seconds 00000100:00100000:3.0:1789185469.856823:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821775488 00000100:00100000:3.0:1789185469.856827:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821775488 00000100:00100000:3.0:1789185469.856848:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789185469.856854:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821775488:12345-0@lo:501: 00000100:00100000:3.0:1789185469.857156:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821775488:12345-0@lo:501: Request processed in 300us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185469.857163:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789185469.857192:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821775488:0@lo:501: 00000100:00100000:3.0:1789185469.857217:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821775616:0@lo:503: 00000100:00100000:3.0:1789185469.857256:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185469.857269:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906537180 going to sleep for 11 seconds 00000100:00100000:3.0:1789185469.857286:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821775616 00000100:00100000:3.0:1789185469.857290:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821775616 00000100:00100000:3.0:1789185469.857311:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789185469.857317:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821775616:12345-0@lo:503: 00000100:00100000:3.0:1789185469.857663:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821775616:12345-0@lo:503: Request processed in 345us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185469.857671:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789185469.857713:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821775616:0@lo:503: 00000100:00100000:0.0:1789185469.870892:0:7953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7953:1876096821775744:0@lo:502: 00000100:00100000:0.0:1789185469.871021:0:7953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185469.871076:0:7953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791aed2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789185469.871207:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821775744 00000100:00100000:3.0:1789185469.871217:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821775744 00000100:00100000:3.0:1789185469.871284:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789185469.871296:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+15:7953:x1876096821775744:12345-0@lo:502: 00000100:00100000:3.0:1789185469.871669:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+15:7953:x1876096821775744:12345-0@lo:502: Request processed in 373us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185469.871678:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789185469.873047:0:7953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7953:1876096821775744:0@lo:502: 00000020:01000000:0.0:1789185469.873105:0:7953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185469.873121:0:7953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185469.873124:0:7953:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789185469.873133:0:7953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789185469.873135:0:7953:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789185469.873176:0:7953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7953:1876096821775872:0@lo:502: 00000100:00100000:0.0:1789185469.873269:0:7953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185469.873322:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821775872 00000100:00100000:0.0:1789185469.873330:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821775872 00000100:00100000:0.0:1789185469.873383:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789185469.873393:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+15:7953:x1876096821775872:12345-0@lo:502: 00000100:00100000:0.0:1789185469.873660:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+15:7953:x1876096821775872:12345-0@lo:502: Request processed in 268us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185469.873669:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789185469.873725:0:7953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791aed2900 going to sleep for 11 seconds 00000100:00100000:0.0:1789185469.873741:0:7953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7953:1876096821775872:0@lo:502: 00000020:01000000:0.0:1789185469.873763:0:7953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185469.873768:0:7953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185469.873770:0:7953:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789185469.873775:0:7953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1789185469.885175:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789185469.885230:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789185469.885244:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04000/0x532743011272b8c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8cc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185469.885262:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c793fe04000/0x532743011272b8c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8cc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185469.885274:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789185469.885277:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c79102db000 from 30 10000000:01000000:3.0:1789185469.885281:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789185469.885331:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe05e00/0x532743011272b8d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185469.885356:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c793fe05e00/0x532743011272b8d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185469.885373:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c793fe05e00/0x532743011272b8d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185469.885431:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821776000:0@lo:101: 00000100:00100000:3.0:1789185469.885520:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185469.885575:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906537180 going to sleep for 11 seconds 00000100:00100000:2.0:1789185469.886946:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821776000 00000100:00100000:2.0:1789185469.886973:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821776000 00000100:00100000:2.0:1789185469.887045:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789185469.887057:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821776000:12345-0@lo:101: 00010000:00010000:2.0:1789185469.887078:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185469.887102:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d7200/0x532743011272b8da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b8d3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185469.887135:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d7200/0x532743011272b8da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b8d3 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185469.887147:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d7200/0x532743011272b8da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b8d3 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185469.887157:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7200, rc 0) 00000100:00100000:2.0:1789185469.887240:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821776000:12345-0@lo:101: Request processed in 185us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185469.887255:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789185469.887427:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821776000:0@lo:101: 00010000:00010000:3.0:1789185469.887450:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c793fe05e00/0x532743011272b8d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8da expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185469.887460:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c793fe05e00/0x532743011272b8d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b8da expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185469.887544:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821776128:0@lo:501: 00000100:00100000:3.0:1789185469.887583:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185469.887618:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906537180 going to sleep for 11 seconds 00000100:00100000:2.0:1789185469.890287:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821776128 00000100:00100000:2.0:1789185469.890310:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821776128 00000100:00100000:2.0:1789185469.890400:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789185469.890437:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821776128:12345-0@lo:501: 00000100:00100000:2.0:1789185469.894062:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821776128:12345-0@lo:501: Request processed in 3613us (6462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185469.894084:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789185469.894429:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821776128:0@lo:501: 00000100:00100000:3.0:1789185469.894510:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821776256:0@lo:503: 00000100:00100000:3.0:1789185469.894581:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185469.894625:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906537180 going to sleep for 11 seconds 00000100:00100000:1.0:1789185469.894697:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821776256 00000100:00100000:1.0:1789185469.894707:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821776256 00000100:00100000:1.0:1789185469.894764:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789185469.894774:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821776256:12345-0@lo:503: 00000100:00100000:1.0:1789185469.895035:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821776256:12345-0@lo:503: Request processed in 261us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185469.895052:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789185469.895101:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821776256:0@lo:503: 00000100:00100000:3.0:1789185469.896782:0:7957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7957:1876096821776384:0@lo:502: 00000100:00100000:3.0:1789185469.896897:0:7957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185469.896968:0:7957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906537540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185469.897080:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821776384 00000100:00100000:2.0:1789185469.897090:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821776384 00000100:00100000:2.0:1789185469.897150:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789185469.897161:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+16:7957:x1876096821776384:12345-0@lo:502: 00000100:00100000:2.0:1789185469.897492:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+16:7957:x1876096821776384:12345-0@lo:502: Request processed in 332us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185469.897501:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789185469.898170:0:7957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7957:1876096821776384:0@lo:502: 00000100:00100000:3.0:1789185469.898259:0:7957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7957:1876096821776512:0@lo:502: 00000100:00100000:3.0:1789185469.898311:0:7957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185469.903642:0:7957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791f9e9300 going to sleep for 11 seconds 00000100:00100000:1.0:1789185469.915606:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821776512 00000100:00100000:1.0:1789185469.915628:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821776512 00000100:00100000:1.0:1789185469.915711:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789185469.915724:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+16:7957:x1876096821776512:12345-0@lo:502: 00000100:00100000:1.0:1789185469.917032:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+16:7957:x1876096821776512:12345-0@lo:502: Request processed in 1303us (18712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185469.917047:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789185469.922624:0:7957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7957:1876096821776512:0@lo:502: 00000040:00080000:3.0:1789185469.922681:0:7957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789185469.930224:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789185469.930283:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789185469.930300:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe05e00/0x532743011272b8d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8da expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185469.930317:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c793fe05e00/0x532743011272b8d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8da expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185469.930473:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789185469.930478:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c79102db000 from 5 10000000:01000000:3.0:1789185469.930482:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789185469.930536:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185469.930545:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185469.930558:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185469.930590:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821776640:0@lo:101: 00000100:00100000:3.0:1789185469.930687:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185469.930738:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791f9e9300 going to sleep for 11 seconds 00000100:00100000:1.0:1789185469.932978:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821776640 00000100:00100000:1.0:1789185469.932999:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821776640 00000100:00100000:1.0:1789185469.933087:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789185469.933099:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821776640:12345-0@lo:101: 00010000:00010000:1.0:1789185469.933122:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185469.933150:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79013eca00/0x532743011272b8e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b8e1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185469.933187:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79013eca00/0x532743011272b8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b8e1 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185469.933224:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79013eca00/0x532743011272b8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b8e1 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185469.933238:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013eca00, rc 0) 00000100:00100000:1.0:1789185469.933352:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821776640:12345-0@lo:101: Request processed in 256us (2666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185469.933360:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789185469.936080:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821776640:0@lo:101: 00010000:00010000:0.0:1789185469.936124:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8e8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.936141:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b8e8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185469.936249:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821776768:0@lo:256: 00000100:00100000:0.0:1789185469.936338:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185469.936388:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7910715240 going to sleep for 11 seconds 00000100:00100000:0.0:1789185469.936464:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821776768 00000100:00100000:0.0:1789185469.936472:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821776768 00000100:00100000:0.0:1789185469.936525:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789185469.936536:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821776768:12345-0@lo:256: 20000000:01000000:0.0:1789185469.936569:0:5817:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789185469.936591:0:5817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789185469.936595:0:5817:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789185469.936693:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821776768:12345-0@lo:256: Request processed in 158us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185469.936700:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789185469.936739:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821776768:0@lo:256: 10000000:01000000:0.0:1789185469.936782:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789185469.936791:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8e8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.937031:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8e8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185469.937042:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789185469.937045:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789185469.937048:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789185469.937078:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7900030200/0x532743011272b8ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.937086:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7900030200/0x532743011272b8ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.937095:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7900030200/0x532743011272b8ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185469.937108:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821776896:0@lo:101: 00000100:00100000:0.0:1789185469.937135:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185469.937160:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821776896 00000100:00100000:0.0:1789185469.937168:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821776896 00000100:00100000:0.0:1789185469.937188:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789185469.937193:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821776896:12345-0@lo:101: 00010000:00010000:0.0:1789185469.937215:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185469.937230:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7900031c00/0x532743011272b8f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b8ef expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.937253:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7900031c00/0x532743011272b8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b8ef expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.937264:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7900031c00/0x532743011272b8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b8ef expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.937273:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7900031c00, rc 0) 00000100:00100000:0.0:1789185469.937296:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821776896:12345-0@lo:101: Request processed in 103us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185469.937302:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789185469.937323:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7910715240 going to sleep for 11 seconds 00000100:00100000:0.0:1789185469.937334:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821776896:0@lo:101: 00010000:00010000:0.0:1789185469.937344:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7900030200/0x532743011272b8ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8f6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.937353:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7900030200/0x532743011272b8ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b8f6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185469.937398:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821777024:0@lo:501: 00000100:00100000:0.0:1789185469.937452:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185469.937468:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821777024 00000100:00100000:0.0:1789185469.937471:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821777024 00000100:00100000:0.0:1789185469.937493:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789185469.937497:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821777024:12345-0@lo:501: 00000100:00100000:0.0:1789185469.937792:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821777024:12345-0@lo:501: Request processed in 293us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185469.938717:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7910715240 going to sleep for 11 seconds 00000100:00100000:1.0:1789185469.938750:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821777024:0@lo:501: 00000100:00100000:1.0:1789185469.938813:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821777152:0@lo:503: 00000100:00100000:1.0:1789185469.938875:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185469.938918:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821777152 00000100:00100000:1.0:1789185469.938925:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821777152 00000100:00100000:1.0:1789185469.938974:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789185469.938983:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821777152:12345-0@lo:503: 00000100:00100000:0.0:1789185469.939432:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789185469.939689:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821777152:12345-0@lo:503: Request processed in 705us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185469.939697:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789185469.939741:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906588180 going to sleep for 11 seconds 00000100:00100000:1.0:1789185469.939760:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821777152:0@lo:503: 00000100:00100000:1.0:1789185469.943929:0:7959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7959:1876096821777280:0@lo:502: 00000100:00100000:1.0:1789185469.944051:0:7959:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185469.944144:0:7959:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906588480 going to sleep for 11 seconds 00000100:00100000:0.0:1789185469.951616:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821777280 00000100:00100000:0.0:1789185469.951639:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821777280 00000100:00100000:0.0:1789185469.951755:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789185469.951767:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:7959:x1876096821777280:12345-0@lo:502: 00000100:00100000:0.0:1789185469.954474:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:7959:x1876096821777280:12345-0@lo:502: Request processed in 2695us (10409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185469.954492:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789185469.956688:0:7959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7959:1876096821777280:0@lo:502: 00000020:01000000:2.0:1789185469.956752:0:7959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789185469.956764:0:7959:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789185469.956775:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185469.956779:0:7959:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789185469.956785:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789185469.956789:0:7959:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:2.0:1789185469.956823:0:7959:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789185469.956827:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789185469.956848:0:7959:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c792f800000) 00000020:00000080:2.0:1789185469.956877:0:7959:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789185469.956891:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789185469.957018:0:7959:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789185469.957026:0:7959:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789185469.957034:0:7959:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x532743011272b904 00010000:00080000:2.0:1789185469.957072:0:7959:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c794102d000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:2.0:1789185469.959690:0:7959:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1789185469.961468:0:7959:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789185469.961496:0:7959:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789185469.962234:0:7959:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185469.962626:0:7959:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185469.962707:0:7959:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789185469.962774:0:7959:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789185469.968560:0:7963:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789185469.968571:0:7963:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789185469.974262:0:7959:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789185469.974295:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789185469.974354:0:7959:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789185469.974442:0:7959:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x532743011272b90b 00000100:00080000:0.0:1789185469.974460:0:7959:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789185469.974476:0:7959:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c794102d000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:0.0:1789185469.974531:0:7959:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7906615880 x1876096821777408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185469.974555:0:7959:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789185469.974624:0:7959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185469.974628:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185469.974630:0:7959:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789185469.974633:0:7959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185469.974638:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185469.974639:0:7959:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789185469.974642:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789185469.974651:0:7959:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789185469.974688:0:7959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906616680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7959:1876096821777536:0@lo:502: 00000100:00100000:0.0:1789185469.974787:0:7959:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185469.975062:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821777664:0@lo:400: 00000100:00100000:1.0:1789185469.975102:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185469.975179:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821777408:0@lo:8: 00000100:00100000:3.0:1789185469.975220:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185469.975302:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821777408 00000100:00100000:3.0:1789185469.975311:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821777408 00000100:00100000:3.0:1789185469.975354:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789185469.975363:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3277:x1876096821777408:12345-0@lo:8: 00010000:00080000:3.0:1789185469.975393:0:6678:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:3.0:1789185469.975449:0:6678:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x532743011272b912 00002000:00100000:3.0:1789185469.975466:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c7936d80000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789185469.975470:0:6678:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1789185469.975475:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789185469.975635:0:6678:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789185469.975830:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789185469.975862:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9c7936d84000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185469.975927:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3277:x1876096821777408:12345-0@lo:8: Request processed in 563us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185469.975935:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789185469.976000:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906615880 x1876096821777408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789185479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185469.976012:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789185469.976022:0:3277:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789185469.976031:0:3277:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789185469.976038:0:3277:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789185469.976041:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c794102d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789185469.976055:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789185469.976062:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821777408:0@lo:8: 00000004:00080000:3.0:1789185469.976111:0:7963:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789185469.976237:0:7963:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 167015830696ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789185469.979575:0:7959:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791aed2180 going to sleep for 11 seconds 00000100:00100000:1.0:1789185469.983032:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821778048:0@lo:400: 00000100:00100000:1.0:1789185469.983127:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185469.983197:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821777792:0@lo:400: 00000100:00100000:0.0:1789185469.983380:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821777536 00000100:00100000:0.0:1789185469.983396:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821777536 00000100:00100000:0.0:1789185469.983476:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821777664 00000100:00100000:0.0:1789185469.983480:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821777664 00000100:00100000:0.0:1789185469.983498:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789185469.983508:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:7959:x1876096821777536:12345-0@lo:502: 00000100:00100000:3.0:1789185469.987210:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821778048 00000100:00100000:3.0:1789185469.987227:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821778048 00000100:00100000:3.0:1789185469.987317:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185469.987328:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821778048:12345-0@lo:400: 00000100:00100000:1.0:1789185469.987779:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185469.988027:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185469.988043:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821777920:0@lo:400: 00000100:00100000:1.0:1789185469.988087:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185469.988147:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789185469.988160:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821777664:12345-0@lo:400: 00000100:00100000:1.0:1789185469.988569:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821777664:12345-0@lo:400: Request processed in 411us (13464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185469.988578:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789185469.988630:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821777792 00000100:00100000:1.0:1789185469.988637:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821777792 00000100:00100000:1.0:1789185469.988674:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821777920 00000100:00100000:1.0:1789185469.988678:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821777920 00000100:00100000:1.0:1789185469.988699:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185469.988707:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821777792:12345-0@lo:400: 00000100:00100000:1.0:1789185469.988750:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821777792:12345-0@lo:400: Request processed in 43us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185469.988757:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185469.988771:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185469.988778:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821777920:12345-0@lo:400: 00000100:00100000:1.0:1789185469.989366:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821777920:12345-0@lo:400: Request processed in 585us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185469.989393:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789185469.989594:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbce00 x1876096821777920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185469.989613:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821777920:0@lo:400: 00010000:00080000:1.0:1789185469.989628:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbd880 x1876096821777792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185469.989636:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821777792:0@lo:400: 00000100:00100000:0.0:1789185469.989985:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+18:7959:x1876096821777536:12345-0@lo:502: Request processed in 6476us (15195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185469.989995:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789185469.991122:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821777664:0@lo:400: 00000100:00100000:1.0:1789185469.991142:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821778176:0@lo:400: 00000100:00100000:1.0:1789185469.991217:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185469.991262:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821778176 00000100:00100000:1.0:1789185469.991269:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821778176 00000100:00100000:0.0:1789185469.992025:0:7959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906616680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:7959:1876096821777536:0@lo:502: 00000020:01000000:0.0:1789185469.992081:0:7959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185469.992090:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185469.992093:0:7959:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789185469.992101:0:7959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1789185469.992272:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789185469.992426:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789185469.992440:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7900030200/0x532743011272b8ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8f6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.992453:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7900030200/0x532743011272b8ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8f6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185469.992467:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789185469.992471:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c7907233380 from 1 10000000:01000000:0.0:1789185469.992474:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789185469.992526:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7900031a00/0x532743011272b919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.992536:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7900031a00/0x532743011272b919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.992548:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7900031a00/0x532743011272b919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185469.992569:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906616680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821778304:0@lo:101: 00000100:00100000:0.0:1789185469.992628:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185469.992662:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79102910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185469.992693:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821778304 00000100:00100000:0.0:1789185469.992699:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821778304 00000100:00100000:0.0:1789185469.992749:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789185469.992759:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821778304:12345-0@lo:101: 00010000:00010000:0.0:1789185469.992777:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185469.992792:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7900030400/0x532743011272b920 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b919 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185469.993007:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789185469.993016:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821778176:12345-0@lo:400: 00000100:00100000:1.0:1789185469.993076:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821778176:12345-0@lo:400: Request processed in 60us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185469.993083:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789185469.993132:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbea00 x1876096821778176/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185469.993147:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821778176:0@lo:400: 00000100:00080000:3.0:1789185469.993718:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185469.993727:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185469.994015:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821778048:12345-0@lo:400: Request processed in 6686us (10885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185469.994027:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789185469.994073:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbf480 x1876096821778048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185469.994088:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821778048:0@lo:400: 00010000:00010000:0.0:1789185469.998297:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7900030400/0x532743011272b920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b919 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.998319:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7900030400/0x532743011272b920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b919 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185469.998332:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7900030400, rc 0) 00000100:00100000:0.0:1789185469.998503:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821778304:12345-0@lo:101: Request processed in 5744us (5872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185469.998513:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789185469.999056:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906616680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821778304:0@lo:101: 00010000:00010000:1.0:1789185469.999085:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7900031a00/0x532743011272b919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b920 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185469.999113:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7900031a00/0x532743011272b919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b920 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185469.999218:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821778432:0@lo:501: 00000100:00100000:1.0:1789185469.999270:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185469.999317:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906560540 going to sleep for 11 seconds 00000100:00100000:0.0:1789185470.003263:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821778432 00000100:00100000:0.0:1789185470.003280:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821778432 00000100:00100000:0.0:1789185470.003342:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789185470.003354:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821778432:12345-0@lo:501: 00000100:00100000:0.0:1789185470.003708:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821778432:12345-0@lo:501: Request processed in 354us (4437us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789185470.003717:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789185470.003784:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821778432:0@lo:501: 10000000:01000000:0.0:1789185470.005192:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789185470.005223:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7900031a00/0x532743011272b919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b920 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185470.005238:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7900031a00/0x532743011272b919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b920 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789185470.135483:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:02000400:3.0:1789185470.232535:0:7979:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000004:00080000:1.0:1789185470.275983:0:7964:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789185470.276026:0:7964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876096821778688:0@lo:7: 00000100:00100000:1.0:1789185470.276125:0:7964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185470.276196:0:7964:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79065600c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185470.276253:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821778560:0@lo:13: 00000100:00100000:1.0:1789185470.276282:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185470.276327:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821778560 00000100:00100000:1.0:1789185470.276336:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821778560 00000100:00100000:1.0:1789185470.276449:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185470.276462:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876096821778560:12345-0@lo:13: 00002000:00000024:1.0:1789185470.276505:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789185470.276562:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876096821778560:12345-0@lo:13: Request processed in 99us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185470.276569:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789185470.276939:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821778688 00000100:00100000:3.0:1789185470.276945:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821778688 00000100:00100000:3.0:1789185470.276988:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789185470.276997:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7964:x1876096821778688:12345-0@lo:7: 00000100:00080000:2.0:1789185470.277742:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789185470.277827:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c780247e680 x1876096821778560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185470.277858:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821778560:0@lo:13: 00002000:00080000:3.0:1789185470.304318:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789185470.304331:0:6678:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789185470.304493:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7964:x1876096821778688:12345-0@lo:7: Request processed in 27491us (28362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185470.304506:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789185470.307272:0:7964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c780247ed80 x1876096821778688/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789185486 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185470.307323:0:7964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876096821778688:0@lo:7: 00000004:00080000:1.0:1789185470.307344:0:7964:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789185470.307402:0:7964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876096821778816:0@lo:5: 00000100:00100000:1.0:1789185470.307497:0:7964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185470.307565:0:7964:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79065600c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185470.308341:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821778816 00000100:00100000:0.0:1789185470.308355:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821778816 00000100:00100000:0.0:1789185470.308462:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789185470.308474:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7964:x1876096821778816:12345-0@lo:5: 00002000:00080000:0.0:1789185470.308513:0:6676:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789185470.308518:0:6676:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789185470.309075:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7964:x1876096821778816:12345-0@lo:5: Request processed in 601us (1575us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789185470.309085:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789185470.309147:0:7964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c780247ed80 x1876096821778816/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185486 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185470.309163:0:7964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876096821778816:0@lo:5: 00000004:00080000:0.0:1789185470.309195:0:7964:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789185470.311018:0:7964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906614380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876096821778944:0@lo:700: 00000100:00100000:0.0:1789185470.311097:0:7964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185470.311164:0:7964:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791aed2180 going to sleep for 11 seconds 00000100:00100000:2.0:1789185470.311890:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821778944 00000100:00100000:2.0:1789185470.311904:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821778944 00000100:00100000:2.0:1789185470.311975:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789185470.311987:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7964:x1876096821778944:12345-0@lo:700: 00000100:00100000:2.0:1789185470.312040:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dba300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1876096821779072:0@lo:700: 00000100:00100000:2.0:1789185470.312110:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185470.312144:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906bef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185470.312736:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821779072 00000100:00100000:1.0:1789185470.312744:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821779072 00000100:00100000:1.0:1789185470.312799:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789185470.312807:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1876096821779072:12345-0@lo:700: 40000000:02000000:1.0:1789185470.407361:0:5829:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1789185470.423884:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1876096821779072:12345-0@lo:700: Request processed in 111066us (111762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185470.423912:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789185470.427109:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dba300 x1876096821779072/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789185486 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185470.427136:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dba300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1876096821779072:0@lo:700: 40000000:02000000:1.0:1789185470.427154:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1789185470.590573:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7964:x1876096821778944:12345-0@lo:700: Request processed in 278567us (279454us total) trans 0 rc 0/0 00010000:00080000:2.0:1789185470.590729:0:7964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906614380 x1876096821778944/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789185486 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185470.590754:0:7964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906614380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876096821778944:0@lo:700: 00000100:00100000:0.0:1789185470.592221:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:1.0:1789185470.592594:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1789185470.592621:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789185470.608928:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:2.0:1789185470.643517:0:7964:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1789185470.646873:0:7964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876096821779200:0@lo:5: 00000100:00100000:2.0:1789185470.651555:0:7964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185470.651678:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821779200 00000100:00100000:2.0:1789185470.651691:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821779200 00000100:00100000:2.0:1789185470.651766:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789185470.651780:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7964:x1876096821779200:12345-0@lo:5: 00000100:00100000:0.0:1789185470.660187:0:7964:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906befc00 going to sleep for 11 seconds 00002000:00080000:0.0:1789185470.669894:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789185470.669924:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789185470.677446:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7964:x1876096821779200:12345-0@lo:5: Request processed in 25626us (25859us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789185470.677464:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789185470.677543:0:7964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936db8a80 x1876096821779200/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185486 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185470.677562:0:7964:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789185470.677583:0:7964:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c7936db8a80 x1876096821779200/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185486 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185470.677598:0:7964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876096821779200:0@lo:5: 00000004:00080000:0.0:1789185470.677616:0:7964:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1789185471.375855:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821779328:0@lo:13: 00000100:00100000:2.0:1789185471.375973:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185471.377597:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821779328 00000100:00100000:1.0:1789185471.377624:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821779328 00000100:00100000:1.0:1789185471.377735:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789185471.377750:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821779328:12345-0@lo:13: 00002000:00000024:1.0:1789185471.377804:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185471.377906:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821779328:12345-0@lo:13: Request processed in 160us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185471.377914:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789185471.378127:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789185471.378179:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c780247d180 x1876096821779328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185471.378206:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821779328:0@lo:13: 00010000:00010000:3.0:1789185471.633715:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185472.669056:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185473.682652:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185474.705287:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185475.481165:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821779584:0@lo:400: 00000100:00100000:1.0:1789185475.481245:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185475.481292:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821780096:0@lo:400: 00000100:00100000:1.0:1789185475.481315:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185475.481335:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789185475.481339:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821779456:0@lo:13: 00000100:00100000:1.0:1789185475.481353:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185475.481362:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821779968:0@lo:400: 00000100:00100000:1.0:1789185475.481376:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185475.481394:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821779712:0@lo:400: 00000100:00100000:1.0:1789185475.481437:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185475.481449:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821780224:0@lo:400: 00000100:00100000:1.0:1789185475.481459:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185475.481639:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185475.481647:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821779840:0@lo:400: 00000100:00100000:1.0:1789185475.481673:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185475.481711:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821779584 00000100:00100000:1.0:1789185475.481719:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821779584 00000100:00100000:1.0:1789185475.481824:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789185475.481836:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821779584:12345-0@lo:400: 00000100:00100000:1.0:1789185475.481893:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821779584:12345-0@lo:400: Request processed in 60us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185475.481899:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789185475.481951:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821780096 00000100:00100000:1.0:1789185475.481957:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821780096 00000100:00100000:1.0:1789185475.481988:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821779712 00000100:00100000:1.0:1789185475.481991:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821779712 00000100:00100000:1.0:1789185475.482019:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821779840 00000100:00100000:1.0:1789185475.482021:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821779840 00000100:00100000:1.0:1789185475.482034:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789185475.482039:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821780096:12345-0@lo:400: 00000100:00100000:1.0:1789185475.482077:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821780096:12345-0@lo:400: Request processed in 33us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185475.482083:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789185475.482095:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789185475.482101:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821779712:12345-0@lo:400: 00000100:00100000:1.0:1789185475.482145:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821779712:12345-0@lo:400: Request processed in 44us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185475.482152:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789185475.482163:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789185475.482169:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821779840:12345-0@lo:400: 00000100:00100000:1.0:1789185475.482194:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821779840:12345-0@lo:400: Request processed in 25us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185475.482199:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789185475.482217:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821779456 00000100:00100000:1.0:1789185475.482220:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821779456 00000100:00100000:1.0:1789185475.482246:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185475.482252:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876096821779456:12345-0@lo:13: 00002000:00000024:1.0:1789185475.482279:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185475.482310:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876096821779456:12345-0@lo:13: Request processed in 58us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185475.482315:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185475.482332:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821779968 00000100:00100000:1.0:1789185475.482335:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821779968 00000100:00100000:1.0:1789185475.482370:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821780224 00000100:00100000:1.0:1789185475.482374:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821780224 00000100:00100000:1.0:1789185475.482391:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789185475.482693:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c780247d880 x1876096821779840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185475.482708:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821779840:0@lo:400: 00010000:00080000:3.0:1789185475.482740:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c780247dc00 x1876096821779712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185475.482749:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821779712:0@lo:400: 00000100:00100000:1.0:1789185475.482934:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821779968:12345-0@lo:400: 00000100:00100000:1.0:1789185475.482974:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821779968:12345-0@lo:400: Request processed in 577us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185475.482981:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789185475.482996:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185475.483002:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1876096821780224:12345-0@lo:400: 00000100:00100000:1.0:1789185475.483044:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1876096821780224:12345-0@lo:400: Request processed in 42us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185475.483050:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789185475.483082:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185475.483086:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185475.483089:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789185475.483127:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c780247d500 x1876096821779456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185475.483145:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821779456:0@lo:13: 00010000:00080000:1.0:1789185475.483156:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c780247e300 x1876096821779968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185475.483164:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821779968:0@lo:400: 00000100:00100000:1.0:1789185475.483173:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821779584:0@lo:400: 00010000:00080000:1.0:1789185475.483183:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c780247f100 x1876096821780096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185475.483191:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821780096:0@lo:400: 00010000:00080000:3.0:1789185475.483594:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c780247f800 x1876096821780224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185475.483616:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821780224:0@lo:400: 00000001:00080000:1.0:1789185475.562087:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1789185475.739122:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185476.519750:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185476.519778:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821780352:0@lo:13: 00000100:00100000:0.0:1789185476.519845:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185476.520268:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821780352 00000100:00100000:1.0:1789185476.520284:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821780352 00000100:00100000:1.0:1789185476.520337:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789185476.520344:0:6681:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789185476.520347:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821780352:12345-0@lo:13: 00000100:00100000:0.0:1789185476.520352:0:6681:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1789185476.520381:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185476.520469:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821780352:12345-0@lo:13: Request processed in 124us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185476.520476:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789185476.520700:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906614380 x1876096821780352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185476.520719:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821780352:0@lo:13: 00010000:00010000:3.0:1789185476.758213:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185477.052869:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185477.052922:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812318848 00000100:00100000:3.0:1789185477.052933:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812318848 00000100:00100000:3.0:1789185477.052985:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00100000:3.0:1789185477.052993:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2368:x1876096812318848:12345-192.168.202.54@tcp:250: 00010000:00080000:3.0:1789185477.053023:0:5816:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 5241da3d-acea-4d5e-9360-a7cef404ad9c@192.168.202.54@tcp t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:3.0:1789185477.053053:0:5816:0:(genops.c:1384:class_connect()) connect: client 5241da3d-acea-4d5e-9360-a7cef404ad9c, cookie 0x532743011272b927 00000100:00080000:3.0:1789185477.053196:0:5816:0:(import.c:65:import_set_state_nolock()) ffff9c7936d82800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185477.053269:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+5:2368:x1876096812318848:12345-192.168.202.54@tcp:250: Request processed in 275us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185477.053278:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00100000:1.0:1789185477.059917:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185477.060098:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812318976 00000100:00100000:0.0:1789185477.060111:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812318976 00000100:00100000:0.0:1789185477.060172:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:0.0:1789185477.060183:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+5:5600:x1876096812318976:12345-192.168.202.54@tcp:101: 00010000:00010000:0.0:1789185477.060201:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185477.060220:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7900031000/0x532743011272b92e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d38b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185477.060252:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7900031000/0x532743011272b92e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d38b expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185477.060265:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7900031000/0x532743011272b92e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d38b expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185477.060275:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7900031000, rc 0) 00000100:00100000:0.0:1789185477.060341:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+6:5600:x1876096812318976:12345-192.168.202.54@tcp:101: Request processed in 160us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185477.060349:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:2.0:1789185477.079779:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185477.079862:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812319104 00000100:00100000:3.0:1789185477.079872:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812319104 00000100:00100000:3.0:1789185477.079943:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00100000:3.0:1789185477.079955:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+6:5600:x1876096812319104:12345-192.168.202.54@tcp:501: 00000100:00100000:3.0:1789185477.080242:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+6:5600:x1876096812319104:12345-192.168.202.54@tcp:501: Request processed in 288us (474us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789185477.080250:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00100000:3.0:1789185477.097303:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185477.097451:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812319232 00000100:00100000:0.0:1789185477.097461:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812319232 00000100:00100000:0.0:1789185477.097571:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:0.0:1789185477.097583:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+6:5600:x1876096812319232:12345-192.168.202.54@tcp:101: 00010000:00010000:0.0:1789185477.097602:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185477.097639:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7900030e00/0x532743011272b935 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d392 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185477.097670:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7900030e00/0x532743011272b935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d392 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185477.097682:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7900030e00/0x532743011272b935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d392 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185477.097691:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7900030e00, rc 0) 00000100:00100000:0.0:1789185477.097747:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+7:5600:x1876096812319232:12345-192.168.202.54@tcp:101: Request processed in 166us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185477.097754:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:1.0:1789185477.102489:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185477.102709:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812319360 00000100:00100000:2.0:1789185477.102720:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812319360 00000100:00100000:2.0:1789185477.102773:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:2.0:1789185477.102782:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+7:5600:x1876096812319360:12345-192.168.202.54@tcp:501: 00000100:00100000:2.0:1789185477.103267:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+8:5600:x1876096812319360:12345-192.168.202.54@tcp:501: Request processed in 482us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185477.103276:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:3.0:1789185477.112636:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185477.112950:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812319488 00000100:00100000:2.0:1789185477.112973:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812319488 00000100:00100000:2.0:1789185477.113032:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:2.0:1789185477.113043:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+8:5600:x1876096812319488:12345-192.168.202.54@tcp:503: 00000100:00100000:2.0:1789185477.113335:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+8:5600:x1876096812319488:12345-192.168.202.54@tcp:503: Request processed in 293us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185477.113354:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:3.0:1789185477.116755:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185477.119211:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812319616 00000100:00100000:2.0:1789185477.119227:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812319616 00000100:00100000:2.0:1789185477.119301:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:2.0:1789185477.119312:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+8:5619:x1876096812319616:12345-192.168.202.54@tcp:502: 00000100:00100000:2.0:1789185477.119688:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+8:5619:x1876096812319616:12345-192.168.202.54@tcp:502: Request processed in 376us (2944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185477.119696:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:2.0:1789185477.149451:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185477.149489:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812319744 00000100:00100000:2.0:1789185477.149499:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812319744 00000100:00100000:2.0:1789185477.149566:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:2.0:1789185477.149576:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+8:5619:x1876096812319744:12345-192.168.202.54@tcp:502: 00000100:00100000:2.0:1789185477.150217:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+8:5619:x1876096812319744:12345-192.168.202.54@tcp:502: Request processed in 641us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185477.150227:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:0.0:1789185477.155818:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185477.156541:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812319872 00000100:00100000:3.0:1789185477.156568:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812319872 00000100:00100000:3.0:1789185477.156631:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:3.0:1789185477.156641:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+8:5600:x1876096812319872:12345-192.168.202.54@tcp:101: 00010000:00010000:3.0:1789185477.156658:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185477.156676:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe05800/0x532743011272b93c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d3bc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185477.156704:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe05800/0x532743011272b93c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3bc expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185477.156715:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe05800/0x532743011272b93c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3bc expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185477.156724:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05800, rc 0) 00000100:00100000:3.0:1789185477.156862:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:5600:x1876096812319872:12345-192.168.202.54@tcp:101: Request processed in 222us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185477.156869:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:2.0:1789185477.168760:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185477.168916:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812320000 00000100:00100000:1.0:1789185477.168927:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812320000 00000100:00100000:1.0:1789185477.169054:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:1.0:1789185477.169067:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:5600:x1876096812320000:12345-192.168.202.54@tcp:256: 20000000:01000000:1.0:1789185477.169096:0:5816:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789185477.169117:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789185477.169122:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789185477.169125:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789185477.169128:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789185477.174077:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:5600:x1876096812320000:12345-192.168.202.54@tcp:256: Request processed in 5001us (5328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185477.174092:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:1.0:1789185477.184198:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185477.184241:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812320128 00000100:00100000:1.0:1789185477.184252:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812320128 00000100:00100000:1.0:1789185477.184305:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:1.0:1789185477.184315:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:5600:x1876096812320128:12345-192.168.202.54@tcp:101: 00010000:00010000:1.0:1789185477.184344:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185477.184363:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79013ed800/0x532743011272b943 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d3c3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185477.184392:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79013ed800/0x532743011272b943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3c3 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185477.184431:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79013ed800/0x532743011272b943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3c3 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185477.184443:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013ed800, rc 0) 00000100:00100000:1.0:1789185477.184498:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5600:x1876096812320128:12345-192.168.202.54@tcp:101: Request processed in 184us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185477.184505:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:2.0:1789185477.191111:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185477.192150:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812320256 00000100:00100000:3.0:1789185477.192164:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812320256 00000100:00100000:3.0:1789185477.192231:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:3.0:1789185477.192242:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5600:x1876096812320256:12345-192.168.202.54@tcp:501: 00000100:00100000:3.0:1789185477.192592:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5600:x1876096812320256:12345-192.168.202.54@tcp:501: Request processed in 351us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185477.192601:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:1.0:1789185477.197949:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185477.197996:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812320384 00000100:00100000:1.0:1789185477.198008:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812320384 00000100:00100000:1.0:1789185477.198056:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:1.0:1789185477.198067:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5600:x1876096812320384:12345-192.168.202.54@tcp:503: 00000100:00100000:1.0:1789185477.198461:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5600:x1876096812320384:12345-192.168.202.54@tcp:503: Request processed in 393us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185477.198470:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:1.0:1789185477.203735:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185477.204086:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812320512 00000100:00100000:3.0:1789185477.204097:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812320512 00000100:00100000:3.0:1789185477.204157:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:3.0:1789185477.204167:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5624:x1876096812320512:12345-192.168.202.54@tcp:502: 00000100:00100000:3.0:1789185477.204486:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5624:x1876096812320512:12345-192.168.202.54@tcp:502: Request processed in 318us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185477.204495:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:2.0:1789185477.212225:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185477.214366:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812320640 00000100:00100000:3.0:1789185477.214384:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812320640 00000100:00100000:3.0:1789185477.214466:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00100000:3.0:1789185477.214477:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5624:x1876096812320640:12345-192.168.202.54@tcp:502: 00000100:00100000:3.0:1789185477.215447:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5624:x1876096812320640:12345-192.168.202.54@tcp:502: Request processed in 967us (3228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185477.215457:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00100000:2.0:1789185477.231252:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185477.231684:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812320768 00000100:00100000:0.0:1789185477.231694:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812320768 00000100:00100000:0.0:1789185477.232449:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:0.0:1789185477.232465:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2368:x1876096812320768:12345-192.168.202.54@tcp:38: 00010000:00080000:0.0:1789185477.232502:0:5823:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:0.0:1789185477.232556:0:5823:0:(genops.c:1384:class_connect()) connect: client 19bfb1a3-97ed-41fd-ac10-946cffd5be7d, cookie 0x532743011272b94a 00000004:00100000:0.0:1789185477.232590:0:5823:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:0.0:1789185477.232596:0:5823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1789185477.285176:0:5823:0:(import.c:65:import_set_state_nolock()) ffff9c78011b0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185477.285255:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2368:x1876096812320768:12345-192.168.202.54@tcp:38: Request processed in 52794us (54014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185477.285266:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00010000:00010000:3.0:1789185477.775930:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185478.046348:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185478.046465:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812320896 00000100:00100000:1.0:1789185478.046477:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812320896 00000100:00080000:2.0:1789185478.046664:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185478.046721:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:3.0:1789185478.046736:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:0:x1876096812320896:12345-192.168.202.54@tcp:41: 00000004:00000024:3.0:1789185478.046789:0:5822:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789185478.046871:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:0:x1876096812320896:12345-192.168.202.54@tcp:41: Request processed in 139us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185478.046878:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:0.0:1789185478.050653:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185478.050834:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812321024 00000100:00100000:2.0:1789185478.050845:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812321024 00000100:00100000:2.0:1789185478.050917:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:2.0:1789185478.050928:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:5600:x1876096812321024:12345-192.168.202.54@tcp:41: 00000004:00000024:2.0:1789185478.050963:0:5823:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789185478.051050:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:5600:x1876096812321024:12345-192.168.202.54@tcp:41: Request processed in 123us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185478.051058:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:2.0:1789185478.053938:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185478.054045:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812321152 00000100:00100000:1.0:1789185478.054055:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812321152 00000100:00100000:1.0:1789185478.054117:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:1.0:1789185478.054143:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:5600:x1876096812321152:12345-192.168.202.54@tcp:40: 00000100:00100000:1.0:1789185478.054236:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:5600:x1876096812321152:12345-192.168.202.54@tcp:40: Request processed in 95us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185478.054243:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1789185478.057942:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185478.058367:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812321536 00000100:00100000:3.0:1789185478.058378:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812321536 00000100:00100000:3.0:1789185478.058469:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:3.0:1789185478.058481:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:5600:x1876096812321536:12345-192.168.202.54@tcp:33: 00000100:00100000:3.0:1789185478.060939:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185478.061000:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185478.061307:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812321280 00000100:00100000:0.0:1789185478.061318:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812321280 00000100:00100000:0.0:1789185478.061359:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812321408 00000100:00100000:0.0:1789185478.061362:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812321408 00000100:00100000:0.0:1789185478.061384:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:0.0:1789185478.061393:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2368:x1876096812321280:12345-192.168.202.54@tcp:8: 00010000:00080000:0.0:1789185478.061450:0:6676:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:0.0:1789185478.061481:0:6676:0:(genops.c:1384:class_connect()) connect: client 19bfb1a3-97ed-41fd-ac10-946cffd5be7d, cookie 0x532743011272b951 00002000:00100000:0.0:1789185478.061494:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 19bfb1a3-97ed-41fd-ac10-946cffd5be7d/ffff9c78011b4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789185478.061527:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789185478.062023:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789185478.062058:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9c78011b1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185478.062132:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2368:x1876096812321280:12345-192.168.202.54@tcp:8: Request processed in 738us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185478.062141:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:0.0:1789185478.062163:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:0.0:1789185478.062168:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2368:x1876096812321408:12345-192.168.202.54@tcp:8: 00010000:00080000:0.0:1789185478.062185:0:6676:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:0.0:1789185478.062202:0:6676:0:(genops.c:1384:class_connect()) connect: client 19bfb1a3-97ed-41fd-ac10-946cffd5be7d, cookie 0x532743011272b958 00002000:00100000:0.0:1789185478.062208:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 19bfb1a3-97ed-41fd-ac10-946cffd5be7d/ffff9c78011b7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789185478.062224:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789185478.062497:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789185478.062514:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9c78011b2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185478.062541:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2368:x1876096812321408:12345-192.168.202.54@tcp:8: Request processed in 371us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185478.062554:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000004:00080000:3.0:1789185478.078972:0:5825:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 20288us 00000004:00200000:3.0:1789185478.089490:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789185478.089636:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:5600:x1876096812321536:12345-192.168.202.54@tcp:33: Request processed in 31151us (31698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185478.089647:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:3.0:1789185478.288503:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185478.288621:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812321664 00000100:00100000:1.0:1789185478.288632:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812321664 00000100:00100000:1.0:1789185478.288701:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:1.0:1789185478.288713:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:5641:x1876096812321664:12345-192.168.202.54@tcp:101: 00010000:00010000:1.0:1789185478.288734:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185478.288807:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ece00/0x532743011272b95f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d3ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185478.288895:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272b966 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185478.288911:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272b966 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185478.288927:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272b966 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185478.288966:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789185478.288970:0:5822:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789185478.288990:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272b966 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185478.289016:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ece00/0x532743011272b95f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3ed expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185478.289055:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272b966 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3ed expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185478.289063:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c791aedc000) 00010000:00010000:1.0:1789185478.289066:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789185478.289069:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013ec000, rc 0) 00000100:00100000:1.0:1789185478.289135:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:5641:x1876096812321664:12345-192.168.202.54@tcp:101: Request processed in 424us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185478.289143:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00010000:00010000:3.0:1789185478.799788:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185479.824081:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789185480.151697:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000100:00100000:2.0:1789185480.597163:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185480.597193:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821780480:0@lo:13: 00000100:00100000:2.0:1789185480.597268:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185480.597933:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821780736:0@lo:400: 00000100:00100000:0.0:1789185480.597971:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185480.597994:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185480.597999:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821780864:0@lo:400: 00000100:00100000:0.0:1789185480.598022:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185480.598192:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821780736 00000100:00100000:2.0:1789185480.598201:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821780736 00000100:00100000:2.0:1789185480.598256:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821780864 00000100:00100000:2.0:1789185480.598260:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821780864 00000100:00100000:2.0:1789185480.598286:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789185480.598294:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821780736:12345-0@lo:400: 00000100:00100000:2.0:1789185480.598359:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821780736:12345-0@lo:400: Request processed in 64us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185480.598368:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789185480.598396:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789185480.598402:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821780864:12345-0@lo:400: 00000100:00100000:2.0:1789185480.598470:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821780864:12345-0@lo:400: Request processed in 68us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185480.598475:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789185480.598491:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185480.598504:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821780608:0@lo:400: 00000100:00100000:2.0:1789185480.598536:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185480.598559:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821781120:0@lo:400: 00000100:00100000:2.0:1789185480.598577:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185480.598616:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185480.598621:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821780992:0@lo:400: 00000100:00100000:2.0:1789185480.598642:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185480.598663:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821780608 00000100:00100000:2.0:1789185480.598666:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821780608 00000100:00100000:2.0:1789185480.598689:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789185480.598694:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821780608:12345-0@lo:400: 00000100:00100000:2.0:1789185480.598721:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821780608:12345-0@lo:400: Request processed in 27us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185480.598726:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789185480.598749:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821781120 00000100:00100000:2.0:1789185480.598752:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821781120 00000100:00100000:2.0:1789185480.598770:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789185480.598775:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821781120:12345-0@lo:400: 00000100:00100000:2.0:1789185480.598810:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821781120:12345-0@lo:400: Request processed in 34us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185480.598816:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789185480.598828:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185480.598847:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821780608:0@lo:400: 00000100:00100000:2.0:1789185480.598870:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821781120:0@lo:400: 00000100:00100000:1.0:1789185480.599288:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821780480 00000100:00100000:1.0:1789185480.599293:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821780480 00000100:00100000:1.0:1789185480.599338:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789185480.599345:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821780480:12345-0@lo:13: 00002000:00000024:1.0:1789185480.599385:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185480.599458:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821780480:12345-0@lo:13: Request processed in 113us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185480.599463:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789185480.600213:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821780864:0@lo:400: 00000100:00100000:0.0:1789185480.600228:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821780736:0@lo:400: 00000100:00100000:0.0:1789185480.600256:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821780992 00000100:00100000:0.0:1789185480.600260:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821780992 00000100:00100000:0.0:1789185480.600320:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789185480.600328:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821780992:12345-0@lo:400: 00000100:00100000:0.0:1789185480.600387:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821780992:12345-0@lo:400: Request processed in 61us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185480.600394:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789185480.601063:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789185480.601069:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789185480.601100:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793ff94a80 x1876096821780992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185480.601112:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821780992:0@lo:400: 00010000:00080000:2.0:1789185480.601125:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbea00 x1876096821780480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185480.601150:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789185480.601171:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821780480:0@lo:13: 00000100:00100000:2.0:1789185480.704522:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185480.704676:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812321792 00000100:00100000:0.0:1789185480.704687:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812321792 00000100:00100000:0.0:1789185480.704823:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:0.0:1789185480.704844:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:5693:x1876096812321792:12345-192.168.202.54@tcp:41: 00000004:00000024:0.0:1789185480.704907:0:5823:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789185480.705028:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:5693:x1876096812321792:12345-192.168.202.54@tcp:41: Request processed in 195us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185480.705036:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00080000:2.0:1789185480.705281:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185480.709838:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185480.710289:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812321920 00000100:00100000:1.0:1789185480.710301:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812321920 00000100:00100000:1.0:1789185480.710528:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789185480.710539:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:5693:x1876096812321920:12345-192.168.202.54@tcp:13: 00002000:00000024:1.0:1789185480.710582:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185480.710662:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:5693:x1876096812321920:12345-192.168.202.54@tcp:13: Request processed in 124us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185480.710669:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:3.0:1789185480.713684:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00080000:2.0:1789185480.713983:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185480.714761:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812322048 00000100:00100000:0.0:1789185480.714912:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812322048 00000100:00100000:0.0:1789185480.715035:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:0.0:1789185480.715046:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:5693:x1876096812322048:12345-192.168.202.54@tcp:13: 00002000:00000024:0.0:1789185480.715074:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789185480.715153:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:5693:x1876096812322048:12345-192.168.202.54@tcp:13: Request processed in 109us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185480.715160:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00080000:2.0:1789185480.715711:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789185480.847807:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185481.615716:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789185481.615753:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821781248:0@lo:13: 00000100:00100000:1.0:1789185481.615873:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185481.616086:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821781248 00000100:00100000:3.0:1789185481.616098:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821781248 00000100:00100000:3.0:1789185481.616172:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185481.616184:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821781248:12345-0@lo:13: 00002000:00000024:3.0:1789185481.616213:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185481.616275:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821781248:12345-0@lo:13: Request processed in 93us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185481.616283:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789185481.616390:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793ff96d80 x1876096821781248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185481.616448:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821781248:0@lo:13: 00010000:00010000:3.0:1789185481.873086:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789185482.710887:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000001:00100000:0.0:1789185482.732787:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00010000:00010000:3.0:1789185482.895743:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789185483.353714:0:8288:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789185483.418098:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185483.418140:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185483.418233:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812322176 00000100:00100000:3.0:1789185483.418244:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812322176 00000100:00100000:3.0:1789185483.418305:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 129 00000100:00100000:3.0:1789185483.418316:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2369:x1876096812322176:12345-192.168.202.54@tcp:400: 00000100:00100000:3.0:1789185483.418391:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2369:x1876096812322176:12345-192.168.202.54@tcp:400: Request processed in 76us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185483.418399:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 129 00000100:00100000:0.0:1789185483.419113:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812322432 00000100:00100000:0.0:1789185483.419120:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812322432 00000100:00100000:0.0:1789185483.420080:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1789185483.420096:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812322432:12345-192.168.202.54@tcp:400: 00000100:00100000:2.0:1789185483.420866:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185483.420903:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185483.421292:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812322432:12345-192.168.202.54@tcp:400: Request processed in 1198us (3146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185483.421304:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1789185483.421328:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812322560 00000100:00100000:0.0:1789185483.421335:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812322560 00000100:00100000:0.0:1789185483.421384:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:0.0:1789185483.421394:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812322560:12345-192.168.202.54@tcp:400: 00000100:00100000:0.0:1789185483.421463:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812322560:12345-192.168.202.54@tcp:400: Request processed in 71us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185483.421469:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00080000:0.0:1789185483.421485:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185483.421497:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185483.422968:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812322304 00000100:00100000:0.0:1789185483.422980:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812322304 00000100:00100000:0.0:1789185483.424119:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:0.0:1789185483.424131:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2369:x1876096812322304:12345-192.168.202.54@tcp:400: 00000100:00100000:0.0:1789185483.424208:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2369:x1876096812322304:12345-192.168.202.54@tcp:400: Request processed in 80us (3345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185483.424215:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00080000:2.0:1789185483.430702:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789185483.920056:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185484.943828:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185485.713901:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821781376:0@lo:13: 00000100:00100000:2.0:1789185485.714006:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185485.714158:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821781376 00000100:00100000:1.0:1789185485.714174:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821781376 00000100:00100000:1.0:1789185485.714261:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789185485.714273:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821781376:12345-0@lo:13: 00002000:00000024:1.0:1789185485.714338:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185485.714399:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821781376:12345-0@lo:13: Request processed in 127us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185485.714435:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789185485.715282:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789185485.715357:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbd880 x1876096821781376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185485.715383:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821781376:0@lo:13: 00000100:00100000:2.0:1789185485.717980:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821781504:0@lo:400: 00000100:00100000:2.0:1789185485.718081:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185485.718135:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821782016:0@lo:400: 00000100:00100000:2.0:1789185485.718167:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185485.718195:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185485.718201:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821781632:0@lo:400: 00000100:00100000:2.0:1789185485.718224:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185485.718265:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821782016 00000100:00100000:2.0:1789185485.718289:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821782016 00000100:00100000:2.0:1789185485.718356:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821781632 00000100:00100000:2.0:1789185485.718360:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821781632 00000100:00100000:2.0:1789185485.718377:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789185485.718386:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821782016:12345-0@lo:400: 00000100:00100000:2.0:1789185485.718496:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821782016:12345-0@lo:400: Request processed in 111us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185485.718505:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789185485.718524:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789185485.718530:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821781632:12345-0@lo:400: 00000100:00100000:2.0:1789185485.718557:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821781632:12345-0@lo:400: Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185485.718884:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821781504 00000100:00100000:3.0:1789185485.718890:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821781504 00000100:00100000:3.0:1789185485.718939:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789185485.718946:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821781504:12345-0@lo:400: 00000100:00100000:3.0:1789185485.718992:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821781504:12345-0@lo:400: Request processed in 47us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185485.718998:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789185485.721726:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789185485.721786:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185485.721850:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821781760:0@lo:400: 00000100:00100000:2.0:1789185485.721955:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185485.722006:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789185485.722015:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821781888:0@lo:400: 00000100:00100000:1.0:1789185485.722645:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821781760 00000100:00100000:1.0:1789185485.722657:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821781760 00000100:00100000:1.0:1789185485.722727:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789185485.722737:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821781760:12345-0@lo:400: 00000100:00100000:1.0:1789185485.727886:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821781760:12345-0@lo:400: Request processed in 5135us (5915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185485.727908:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789185485.732698:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185485.732780:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821781632:0@lo:400: 00000100:00100000:3.0:1789185485.732799:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821781504:0@lo:400: 00000100:00100000:3.0:1789185485.732824:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821782016:0@lo:400: 00000100:00100000:2.0:1789185485.738919:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185485.739032:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821781760:0@lo:400: 00000100:00100000:0.0:1789185485.739188:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821781888 00000100:00100000:0.0:1789185485.739199:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821781888 00000100:00100000:0.0:1789185485.739290:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789185485.739301:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821781888:12345-0@lo:400: 00000100:00100000:0.0:1789185485.739389:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821781888:12345-0@lo:400: Request processed in 90us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185485.739397:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789185485.740850:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dc0380 x1876096821781888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185485.740871:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821781888:0@lo:400: 00000100:00080000:3.0:1789185485.741354:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789185485.968634:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185486.737035:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185486.737129:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821782144:0@lo:13: 00000100:00100000:3.0:1789185486.737222:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185486.737599:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821782144 00000100:00100000:1.0:1789185486.737612:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821782144 00000100:00100000:1.0:1789185486.737680:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185486.737691:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821782144:12345-0@lo:13: 00002000:00000024:1.0:1789185486.737733:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185486.737788:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821782144:12345-0@lo:13: Request processed in 100us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185486.737816:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789185486.738619:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793ff94e00 x1876096821782144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185486.738647:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821782144:0@lo:13: 00010000:00010000:1.0:1789185486.991927:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789185487.446710:0:8436:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc57bf4000 20000000:00000080:0.0:1789185487.446732:0:8436:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c7936df3800 uarg=0000000000000000 20000000:01000000:0.0:1789185487.446863:0:8436:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789185487.446867:0:8436:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789185487.446869:0:8436:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789185487.446875:0:8436:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789185487.446881:0:8436:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789185487.446899:0:8436:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789185487.446902:0:8436:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789185487.447115:0:8436:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789185487.447118:0:8436:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789185487.450662:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1789185487.451565:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1789185487.451630:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1789185487.451687:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1789185487.451705:0:8436:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789185487.451708:0:8436:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789185487.456083:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789185487.456808:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789185487.456890:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1789185487.456931:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1789185487.456946:0:8436:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789185487.456958:0:8436:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789185487.458814:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1789185487.466397:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1789185487.472680:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1789185487.472742:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1789185487.472780:0:8436:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789185487.472784:0:8436:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789185487.483145:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1789185487.484018:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1789185487.484080:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1789185487.484118:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1789185487.484136:0:8436:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789185487.484164:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c79234d6200/0x532743011272b96d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.484188:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79234d6e00/0x532743011272b86a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b863 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.484197:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7900030000/0x532743011272b894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b88d expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.484205:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79234d6a00/0x532743011272b8be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b8b7 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.484213:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c793fe05200/0x532743011272b8cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b8c5 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.484221:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79234d7200/0x532743011272b8da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b8d3 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.484228:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7900031c00/0x532743011272b8f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b8ef expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.484236:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7900030400/0x532743011272b920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b919 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.484260:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7900031000/0x532743011272b92e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d38b expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.484267:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7900030e00/0x532743011272b935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d392 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.484275:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c79234d6200/0x532743011272b96d lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.484324:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7900030e00/0x532743011272b935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d392 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.484346:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7900030e00/0x532743011272b935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d392 expref: 9 pid: 5816 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185487.484365:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821782272:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789185487.486733:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7900031000/0x532743011272b92e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d38b expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.486755:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7900031000/0x532743011272b92e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d38b expref: 9 pid: 5817 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185487.486773:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d02300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821782400:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789185487.486836:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7900030400/0x532743011272b920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b919 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.486845:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7900030400/0x532743011272b920 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b919 expref: 18 pid: 5816 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185487.486877:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d03100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821782528:0@lo:104: 00000100:00100000:2.0:1789185487.486928:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789185487.486975:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7900031c00/0x532743011272b8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b8ef expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.486985:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7900031c00/0x532743011272b8f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b8ef expref: 18 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185487.486993:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d02a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821782656:0@lo:104: 00000100:00100000:2.0:1789185487.487020:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789185487.487051:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79234d7200/0x532743011272b8da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b8d3 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.487059:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c79234d7200/0x532743011272b8da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b8d3 expref: 18 pid: 5816 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185487.487068:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d00700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821782784:0@lo:104: 00010000:00010000:2.0:1789185487.487093:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c793fe05200/0x532743011272b8cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b8c5 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.487101:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c793fe05200/0x532743011272b8cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b8c5 expref: 18 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185487.487108:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d00a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821782912:0@lo:104: 00010000:00010000:2.0:1789185487.487131:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79234d6a00/0x532743011272b8be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b8b7 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.487138:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c79234d6a00/0x532743011272b8be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b8b7 expref: 18 pid: 5816 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185487.487153:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821783040:0@lo:104: 00010000:00010000:2.0:1789185487.487181:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7900030000/0x532743011272b894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b88d expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.487189:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7900030000/0x532743011272b894 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b88d expref: 18 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185487.487196:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d03b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821783168:0@lo:104: 00010000:00010000:2.0:1789185487.487220:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79234d6e00/0x532743011272b86a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b863 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.487228:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c79234d6e00/0x532743011272b86a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b863 expref: 18 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185487.487235:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821783296:0@lo:104: 00000100:00100000:2.0:1789185487.487252:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c793f51e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789185487.487893:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789185487.487924:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185487.487938:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185487.487947:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185487.487955:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185487.487963:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185487.487973:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821782528 00000100:00100000:3.0:1789185487.487983:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821782528 00000100:00100000:3.0:1789185487.488035:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821782656 00000100:00100000:3.0:1789185487.488038:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821782656 00000100:00100000:3.0:1789185487.488048:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821782784 00000100:00100000:3.0:1789185487.488050:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821782784 00000100:00100000:3.0:1789185487.488060:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821782912 00000100:00100000:3.0:1789185487.488063:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821782912 00000100:00100000:3.0:1789185487.488088:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821783040 00000100:00100000:3.0:1789185487.488090:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821783040 00000100:00100000:3.0:1789185487.488098:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821783168 00000100:00100000:3.0:1789185487.488100:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821783168 00000100:00100000:3.0:1789185487.488108:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821783296 00000100:00100000:3.0:1789185487.488110:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821783296 00000100:00100000:3.0:1789185487.488125:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185487.488135:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+9:8436:x1876096821782528:12345-0@lo:104: 00010000:00010000:3.0:1789185487.488151:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7900031a00/0x532743011272b919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b920 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488238:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789185487.488245:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+9:8436:x1876096821782528:12345-0@lo:104: Request processed in 112us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185487.488253:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185487.488273:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789185487.488280:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+8:8436:x1876096821782656:12345-0@lo:104: 00010000:00010000:3.0:1789185487.488288:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7900030200/0x532743011272b8ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b8f6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488322:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789185487.488327:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+8:8436:x1876096821782656:12345-0@lo:104: Request processed in 48us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185487.488332:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789185487.488367:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789185487.488373:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+7:8436:x1876096821782784:12345-0@lo:104: 00010000:00010000:3.0:1789185487.488380:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c793fe05e00/0x532743011272b8d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b8da expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488446:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789185487.488451:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+7:8436:x1876096821782784:12345-0@lo:104: Request processed in 79us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185487.488458:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789185487.488472:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789185487.488479:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+6:8436:x1876096821782912:12345-0@lo:104: 00010000:00010000:3.0:1789185487.488487:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c793fe04000/0x532743011272b8c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b8cc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488513:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789185487.488518:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+6:8436:x1876096821782912:12345-0@lo:104: Request processed in 41us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185487.488523:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789185487.488535:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789185487.488540:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+5:8436:x1876096821783040:12345-0@lo:104: 00010000:00010000:3.0:1789185487.488547:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7900030800/0x532743011272b8b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b8be expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488572:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789185487.488578:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+5:8436:x1876096821783040:12345-0@lo:104: Request processed in 38us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185487.488583:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789185487.488595:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789185487.488601:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+4:8436:x1876096821783168:12345-0@lo:104: 00010000:00010000:3.0:1789185487.488608:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b88d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b894 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488640:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1789185487.488646:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+4:8436:x1876096821783168:12345-0@lo:104: Request processed in 45us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185487.488652:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789185487.488664:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789185487.488671:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:8436:x1876096821783296:12345-0@lo:104: 00010000:00010000:3.0:1789185487.488677:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b86a expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488702:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1789185487.488706:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:8436:x1876096821783296:12345-0@lo:104: Request processed in 37us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185487.488711:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789185487.488729:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1789185487.488735:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7900031a00/0x532743011272b919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b920 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488742:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7900031a00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185487.488747:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7900031a00/0x532743011272b919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b920 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488757:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7900031a00/0x532743011272b919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b920 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185487.488765:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7900031a00/0x532743011272b919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b920 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185487.488771:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185487.488828:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7900031a00/0x532743011272b919 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b920 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488835:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185487.488857:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7900031a00/0x532743011272b919 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b920 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488866:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7900031a00/0x532743011272b919 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b920 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488885:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1789185487.488889:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7900030200/0x532743011272b8ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b8f6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488895:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7900030200 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185487.488898:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7900030200/0x532743011272b8ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b8f6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488907:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7900030200/0x532743011272b8ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b8f6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185487.488913:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7900030200/0x532743011272b8ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b8f6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185487.488919:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185487.488934:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7900030200/0x532743011272b8ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b8f6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488940:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185487.488946:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7900030200/0x532743011272b8ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b8f6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488963:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7900030200/0x532743011272b8ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b8f6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488973:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789185487.488976:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c793fe05e00/0x532743011272b8d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b8da expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488981:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05e00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185487.488985:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c793fe05e00/0x532743011272b8d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b8da expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.488991:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c793fe05e00/0x532743011272b8d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b8da expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185487.488998:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c793fe05e00/0x532743011272b8d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b8da expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185487.489003:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185487.489016:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c793fe05e00/0x532743011272b8d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b8da expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489022:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185487.489039:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c793fe05e00/0x532743011272b8d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b8da expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489046:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c793fe05e00/0x532743011272b8d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b8da expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489055:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789185487.489064:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c793fe04000/0x532743011272b8c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b8cc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489070:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04000 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185487.489074:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c793fe04000/0x532743011272b8c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b8cc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489080:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c793fe04000/0x532743011272b8c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b8cc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185487.489086:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c793fe04000/0x532743011272b8c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b8cc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185487.489092:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185487.489105:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c793fe04000/0x532743011272b8c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b8cc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489111:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185487.489117:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c793fe04000/0x532743011272b8c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b8cc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489124:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c793fe04000/0x532743011272b8c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b8cc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489132:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789185487.489135:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7900030800/0x532743011272b8b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b8be expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489142:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7900030800 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185487.489145:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7900030800/0x532743011272b8b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b8be expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489161:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7900030800/0x532743011272b8b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b8be expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185487.489167:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7900030800/0x532743011272b8b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b8be expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185487.489172:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185487.489184:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7900030800/0x532743011272b8b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b8be expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489189:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185487.489194:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7900030800/0x532743011272b8b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b8be expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489201:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7900030800/0x532743011272b8b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b8be expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489210:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185487.489213:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b88d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b894 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489219:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7901520800 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185487.489222:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b88d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b894 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489230:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b88d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b894 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185487.489235:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b88d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b894 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185487.489250:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185487.489263:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b88d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b894 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489270:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185487.489274:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b88d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b894 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489282:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7901520800/0x532743011272b88d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b894 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489292:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185487.489296:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b86a expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489302:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7901520c00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185487.489305:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b86a expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489313:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b86a expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185487.489319:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b86a expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185487.489325:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185487.489336:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b863 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b86a expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489342:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185487.489353:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b863 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b86a expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489359:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7901520c00/0x532743011272b863 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b86a expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185487.489373:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185487.489375:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185487.489377:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185487.489397:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821783552:0@lo:103: 00000100:00100000:3.0:1789185487.489473:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185487.489502:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821784064:0@lo:103: 00000100:00100000:3.0:1789185487.489523:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185487.489545:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789185487.489552:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821783424:0@lo:103: 00000100:00100000:3.0:1789185487.489571:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185487.489586:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821783936:0@lo:103: 00000100:00100000:3.0:1789185487.489622:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185487.489651:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821783680:0@lo:103: 00000100:00100000:3.0:1789185487.489676:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185487.489685:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821784192:0@lo:103: 00000100:00100000:3.0:1789185487.489705:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185487.489716:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185487.489722:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821783808:0@lo:103: 00000100:00100000:3.0:1789185487.489745:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789185487.489941:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185487.489957:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821783552 00000100:00100000:1.0:1789185487.489964:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821783552 00010000:00010000:1.0:1789185487.490002:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7900031c00/0x532743011272b8f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b8ef expref: 19 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185487.490024:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821784064 00000100:00100000:1.0:1789185487.490027:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821784064 00010000:00010000:1.0:1789185487.490039:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7900030000/0x532743011272b894 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b88d expref: 20 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185487.490050:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821783424 00000100:00100000:1.0:1789185487.490052:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821783424 00010000:00010000:1.0:1789185487.490062:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7900030400/0x532743011272b920 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b919 expref: 21 pid: 5816 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185487.490073:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821783936 00000100:00100000:1.0:1789185487.490076:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821783936 00010000:00010000:1.0:1789185487.490086:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79234d6a00/0x532743011272b8be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b8b7 expref: 22 pid: 5816 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185487.490095:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821783680 00000100:00100000:1.0:1789185487.490098:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821783680 00010000:00010000:1.0:1789185487.490117:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79234d7200/0x532743011272b8da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b8d3 expref: 23 pid: 5816 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185487.490128:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821784192 00000100:00100000:1.0:1789185487.490131:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821784192 00010000:00010000:1.0:1789185487.490141:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79234d6e00/0x532743011272b86a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b863 expref: 24 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185487.490151:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821783808 00000100:00100000:1.0:1789185487.490153:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821783808 00010000:00010000:1.0:1789185487.490165:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c793fe05200/0x532743011272b8cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b8c5 expref: 25 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185487.490177:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789185487.490185:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+25:3279:x1876096821783552:12345-0@lo:103: 00010000:00010000:1.0:1789185487.490200:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185487.490207:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7900031c00/0x532743011272b8f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b8ef expref: 25 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185487.490219:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7900031c00/0x532743011272b8f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b8ef expref: 25 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185487.490241:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185487.490290:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+25:3279:x1876096821783552:12345-0@lo:103: Request processed in 106us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185487.490297:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789185487.490317:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789185487.490323:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+24:3279:x1876096821784064:12345-0@lo:103: 00010000:00010000:1.0:1789185487.490331:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185487.490335:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7900030000/0x532743011272b894 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b88d expref: 24 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185487.490350:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7900030000/0x532743011272b894 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b88d expref: 24 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185487.490360:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185487.490386:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+24:3279:x1876096821784064:12345-0@lo:103: Request processed in 63us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185487.490392:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789185487.490434:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185487.490441:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+23:3279:x1876096821783424:12345-0@lo:103: 00010000:00010000:1.0:1789185487.490449:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185487.490454:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7900030400/0x532743011272b920 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b919 expref: 23 pid: 5816 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185487.490462:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7900030400/0x532743011272b920 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b919 expref: 23 pid: 5816 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185487.490472:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185487.490493:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+23:3279:x1876096821783424:12345-0@lo:103: Request processed in 54us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185487.490500:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185487.490512:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185487.490517:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+22:3279:x1876096821783936:12345-0@lo:103: 00010000:00010000:1.0:1789185487.490526:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185487.490530:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79234d6a00/0x532743011272b8be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b8b7 expref: 22 pid: 5816 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185487.490538:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79234d6a00/0x532743011272b8be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b8b7 expref: 22 pid: 5816 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185487.490554:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185487.490578:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+22:3279:x1876096821783936:12345-0@lo:103: Request processed in 60us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185487.490583:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185487.490596:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789185487.490601:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+21:3280:x1876096821783680:12345-0@lo:103: 00010000:00010000:1.0:1789185487.490609:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185487.490613:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79234d7200/0x532743011272b8da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b8d3 expref: 21 pid: 5816 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185487.490620:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79234d7200/0x532743011272b8da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b8d3 expref: 21 pid: 5816 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185487.490628:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185487.490659:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+21:3280:x1876096821783680:12345-0@lo:103: Request processed in 57us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185487.490664:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789185487.490674:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789185487.490680:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+20:3280:x1876096821784192:12345-0@lo:103: 00010000:00010000:1.0:1789185487.490686:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185487.490690:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79234d6e00/0x532743011272b86a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b863 expref: 20 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185487.490697:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79234d6e00/0x532743011272b86a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b863 expref: 20 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185487.490705:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185487.490731:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+20:3280:x1876096821784192:12345-0@lo:103: Request processed in 51us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185487.490737:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789185487.490748:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789185487.490753:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791f905450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821783808:12345-0@lo:103: 00010000:00010000:1.0:1789185487.490760:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185487.490764:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c793fe05200/0x532743011272b8cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b8c5 expref: 19 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185487.493113:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c793fe05200/0x532743011272b8cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b8c5 expref: 19 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185487.493150:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185487.493251:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791f905450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821783808:12345-0@lo:103: Request processed in 2495us (3502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185487.493262:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789185487.493372:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821783808:0@lo:103: 00000100:00100000:1.0:1789185487.493383:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821783680:0@lo:103: 00000100:00100000:1.0:1789185487.493391:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821784192:0@lo:103: 00010000:00010000:0.0:1789185487.493803:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7900030400/0x532743011272b920 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b919 expref: 18 pid: 5816 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185487.493821:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d03100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821782528:0@lo:104: 00010000:00010000:0.0:1789185487.493833:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7900031c00/0x532743011272b8f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b8ef expref: 17 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185487.493843:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d02a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821782656:0@lo:104: 00010000:00010000:0.0:1789185487.493854:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d7200/0x532743011272b8da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b8d3 expref: 16 pid: 5816 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185487.493862:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d00700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821782784:0@lo:104: 00010000:00010000:0.0:1789185487.493873:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c793fe05200/0x532743011272b8cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b8c5 expref: 15 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185487.493881:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d00a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821782912:0@lo:104: 00010000:00010000:0.0:1789185487.493892:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d6a00/0x532743011272b8be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b8b7 expref: 14 pid: 5816 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185487.493901:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821783040:0@lo:104: 00010000:00010000:0.0:1789185487.493911:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7900030000/0x532743011272b894 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b88d expref: 13 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185487.493920:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d03b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821783168:0@lo:104: 00010000:00010000:0.0:1789185487.493931:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d6e00/0x532743011272b86a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b863 expref: 12 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185487.493963:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821783296:0@lo:104: 00000100:00100000:3.0:1789185487.494395:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821783424:0@lo:103: 00000100:00100000:3.0:1789185487.494439:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821783936:0@lo:103: 00000100:00100000:3.0:1789185487.494461:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821783552:0@lo:103: 00000100:00100000:3.0:1789185487.494470:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821784064:0@lo:103: 00000100:00100000:0.0:1789185487.500975:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185487.501044:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185487.501115:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821782272:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789185487.501127:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d02300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1876096821782400:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789185487.501179:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c79234d6200/0x532743011272b96d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185487.516429:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812322816 00000100:00100000:3.0:1789185487.516452:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812322816 00010000:00010000:2.0:1789185487.516596:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7900031000/0x532743011272b92e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d38b expref: 10 pid: 5817 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185487.516658:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812322688 00000100:00100000:2.0:1789185487.516662:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812322688 00010000:00010000:2.0:1789185487.516677:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7900030e00/0x532743011272b935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d392 expref: 11 pid: 5816 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185487.516708:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:2.0:1789185487.516719:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:2371:x1876096812322816:12345-192.168.202.54@tcp:103: 00010000:00010000:2.0:1789185487.516738:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185487.516761:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7900031000/0x532743011272b92e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d38b expref: 11 pid: 5817 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.516775:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7900031000/0x532743011272b92e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d38b expref: 11 pid: 5817 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.516808:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7900031000/0x532743011272b92e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d38b expref: 11 pid: 5817 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.516830:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185487.516907:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2371:x1876096812322816:12345-192.168.202.54@tcp:103: Request processed in 189us (15944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185487.516914:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:2.0:1789185487.516936:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:2.0:1789185487.516943:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:2371:x1876096812322688:12345-192.168.202.54@tcp:103: 00010000:00010000:2.0:1789185487.516951:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185487.516955:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7900030e00/0x532743011272b935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d392 expref: 9 pid: 5816 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.516971:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7900030e00/0x532743011272b935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d392 expref: 9 pid: 5816 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.516981:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7900030e00/0x532743011272b935 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d392 expref: 9 pid: 5816 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.516996:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c79234d6200/0x532743011272b96d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.517006:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d6200/0x532743011272b96d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.517034:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c79234d6200/0x532743011272b96d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.517042:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c79234d6200/0x532743011272b96d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.517049:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c79234d6200/0x532743011272b96d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.517057:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c79234d6200/0x532743011272b96d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.517065:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6200 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185487.517070:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c79234d6200/0x532743011272b96d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.517080:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c79234d6200/0x532743011272b96d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.517096:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c79234d6200/0x532743011272b96d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185487.517108:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185487.517129:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5241da3d-acea-4d5e-9360-a7cef404ad9c+8:2371:x1876096812322688:12345-192.168.202.54@tcp:103: Request processed in 187us (16085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185487.517135:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00010000:00010000:0.0:1789185487.521279:0:8436:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c79234d6200/0x532743011272b96d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185487.521307:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c79234d6200/0x532743011272b96d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185487.521348:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d6200/0x532743011272b96d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185488.015714:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185488.519986:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185488.520040:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185488.520084:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185488.520128:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185488.520165:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812322944 00000100:00100000:0.0:1789185488.520165:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812323328 00000100:00100000:1.0:1789185488.520176:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812322944 00000100:00100000:0.0:1789185488.520186:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812323328 00000100:00100000:1.0:1789185488.520238:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:0.0:1789185488.520238:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812323200 00000100:00100000:0.0:1789185488.520241:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812323200 00000100:00100000:0.0:1789185488.520263:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789185488.520268:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+8:2370:x1876096812322944:12345-192.168.202.54@tcp:400: 00000100:00100000:0.0:1789185488.520269:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812323328:12345-192.168.202.54@tcp:400: 00000100:00100000:1.0:1789185488.520356:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+8:2370:x1876096812322944:12345-192.168.202.54@tcp:400: Request processed in 90us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185488.520371:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812323072 00000100:00100000:1.0:1789185488.520375:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:2.0:1789185488.520376:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812323072 00000100:00100000:2.0:1789185488.520452:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:2.0:1789185488.520469:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812323072:12345-192.168.202.54@tcp:400: 00000100:00100000:1.0:1789185488.520562:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1789185488.520571:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812323200:12345-192.168.202.54@tcp:400: 00000100:00080000:3.0:1789185488.520667:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185488.520672:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789185488.520675:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185488.521261:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812323328:12345-192.168.202.54@tcp:400: Request processed in 986us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185488.521273:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:2.0:1789185488.526061:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812323072:12345-192.168.202.54@tcp:400: Request processed in 5572us (6068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185488.526083:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:1.0:1789185488.526251:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812323200:12345-192.168.202.54@tcp:400: Request processed in 5678us (6119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185488.526262:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 10000000:01000000:2.0:1789185488.975612:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789185488.975624:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c793f2ba800 from 39 10000000:01000000:2.0:1789185488.975633:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789185488.975701:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185488.975714:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185488.975729:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185488.975761:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d02680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821784320:0@lo:101: 00000100:00100000:2.0:1789185488.975991:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185488.976124:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907e73540 going to sleep for 11 seconds 00000100:00100000:3.0:1789185488.983883:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821784320 00000100:00100000:3.0:1789185488.983907:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821784320 00000100:00100000:3.0:1789185488.984008:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789185488.984021:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+12:5820:x1876096821784320:12345-0@lo:101: 00010000:00010000:3.0:1789185488.984044:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185488.984072:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe04000/0x532743011272b97b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b974 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185488.984121:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe04000/0x532743011272b97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b974 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185488.984136:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe04000/0x532743011272b97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b974 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185488.984148:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04000, rc 0) 00000100:00100000:3.0:1789185488.984271:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+13:5820:x1876096821784320:12345-0@lo:101: Request processed in 252us (8280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185488.984278:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789185488.984621:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d02680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821784320:0@lo:101: 00010000:00010000:0.0:1789185488.984644:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b97b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185488.984673:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b97b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185488.984761:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821784448:0@lo:501: 00000100:00100000:0.0:1789185488.984813:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185488.984851:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185488.984874:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821784448 00000100:00100000:0.0:1789185488.984879:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821784448 00000100:00100000:0.0:1789185488.984906:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789185488.984914:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:5820:x1876096821784448:12345-0@lo:501: 00000100:00100000:0.0:1789185488.985246:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:5820:x1876096821784448:12345-0@lo:501: Request processed in 331us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185488.985255:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789185488.985296:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821784448:0@lo:501: 00000100:00100000:0.0:1789185488.985326:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821784576:0@lo:503: 00000100:00100000:0.0:1789185488.985368:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185488.985383:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185488.985396:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821784576 00000100:00100000:0.0:1789185488.985400:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821784576 00000100:00100000:0.0:1789185488.985486:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789185488.985492:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:5820:x1876096821784576:12345-0@lo:503: 00000100:00100000:0.0:1789185488.985663:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:5820:x1876096821784576:12345-0@lo:503: Request processed in 170us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185488.985670:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789185488.985707:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821784576:0@lo:503: 00000100:00100000:1.0:1789185488.986866:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8455:1876096821784704:0@lo:502: 00000100:00100000:1.0:1789185488.986941:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185488.986987:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79192ea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185488.987221:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821784704 00000100:00100000:0.0:1789185488.987229:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821784704 00000100:00100000:0.0:1789185488.987327:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789185488.987339:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:8455:x1876096821784704:12345-0@lo:502: 00000100:00100000:0.0:1789185488.987830:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+13:8455:x1876096821784704:12345-0@lo:502: Request processed in 492us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185488.987839:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789185488.987940:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8455:1876096821784704:0@lo:502: 00000100:00100000:1.0:1789185488.987999:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8455:1876096821784832:0@lo:502: 00000100:00100000:1.0:1789185488.988042:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185488.989486:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79192ea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185488.990997:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821784832 00000100:00100000:2.0:1789185488.991013:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821784832 00000100:00100000:2.0:1789185488.991081:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789185488.991094:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:8455:x1876096821784832:12345-0@lo:502: 00000100:00100000:2.0:1789185488.995295:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:8455:x1876096821784832:12345-0@lo:502: Request processed in 4188us (7236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185488.995315:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789185488.995564:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8455:1876096821784832:0@lo:502: 00000040:00080000:1.0:1789185488.995614:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789185488.995838:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789185488.995865:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789185488.995877:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b97b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185488.995892:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b97b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185488.995922:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789185488.995926:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789185488.995929:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789185488.995970:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185488.995979:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185488.995991:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185488.996016:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821784960:0@lo:101: 00000100:00100000:1.0:1789185488.996076:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185488.996119:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79192ea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185488.996400:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821784960 00000100:00100000:2.0:1789185488.996587:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821784960 00000100:00100000:2.0:1789185488.996645:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789185488.996656:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+13:5820:x1876096821784960:12345-0@lo:101: 00010000:00010000:2.0:1789185488.996673:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185488.996689:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d7800/0x532743011272b989 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b982 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185488.996721:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d7800/0x532743011272b989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b982 expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185488.996735:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d7800/0x532743011272b989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b982 expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185488.996745:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7800, rc 0) 00000100:00100000:2.0:1789185488.997330:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821784960:12345-0@lo:101: Request processed in 673us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185488.997342:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789185488.997399:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821784960:0@lo:101: 00010000:00010000:1.0:1789185488.997553:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b989 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185488.997567:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b989 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185488.997643:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821785088:0@lo:501: 00000100:00100000:1.0:1789185488.997695:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185488.997821:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79192ea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185488.998341:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821785088 00000100:00100000:0.0:1789185488.998349:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821785088 00000100:00100000:0.0:1789185489.004328:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789185489.004356:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821785088:12345-0@lo:501: 00000100:00100000:0.0:1789185489.004742:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821785088:12345-0@lo:501: Request processed in 402us (7046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185489.004753:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789185489.005031:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821785088:0@lo:501: 00000100:00100000:2.0:1789185489.005272:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821785216:0@lo:503: 00000100:00100000:2.0:1789185489.005358:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185489.005578:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907e73540 going to sleep for 11 seconds 00000100:00100000:3.0:1789185489.007734:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821785216 00000100:00100000:3.0:1789185489.007756:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821785216 00000100:00100000:3.0:1789185489.007932:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789185489.007945:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821785216:12345-0@lo:503: 00000100:00100000:3.0:1789185489.008600:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821785216:12345-0@lo:503: Request processed in 656us (3240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185489.008610:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789185489.008745:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821785216:0@lo:503: 00000100:00100000:1.0:1789185489.012733:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8456:1876096821785344:0@lo:502: 00000100:00100000:1.0:1789185489.012853:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185489.012970:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79192eaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789185489.013122:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821785344 00000100:00100000:0.0:1789185489.013130:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821785344 00000100:00100000:0.0:1789185489.013181:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789185489.013190:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:8456:x1876096821785344:12345-0@lo:502: 00000100:00100000:1.0:1789185489.015898:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+14:8456:x1876096821785344:12345-0@lo:502: Request processed in 2700us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185489.015912:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789185489.016093:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8456:1876096821785344:0@lo:502: 00000020:01000000:3.0:1789185489.016130:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185489.016140:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185489.016143:0:8456:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789185489.016149:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789185489.016192:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8456:1876096821785472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185489.016321:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185489.016737:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c792f6a1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185489.016849:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821785472 00000100:00100000:0.0:1789185489.016856:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821785472 00000100:00100000:1.0:1789185489.017097:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789185489.017108:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+14:8456:x1876096821785472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185489.017349:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+14:8456:x1876096821785472:12345-0@lo:502:llog_process_th.0 Request processed in 243us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185489.017357:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789185489.017652:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8456:1876096821785472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789185489.017683:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185489.017690:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185489.017692:0:8456:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789185489.017696:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789185489.017963:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789185489.017982:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789185489.017992:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b989 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.018012:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b989 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185489.018037:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789185489.018040:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c791f9b0000 from 39 10000000:01000000:0.0:1789185489.018043:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789185489.018073:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.018081:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.018091:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185489.018109:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821785600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.018147:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185489.023329:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185489.023911:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821785600 00000100:00100000:1.0:1789185489.023922:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821785600 00000100:00100000:1.0:1789185489.023967:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789185489.023976:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+14:5820:x1876096821785600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185489.023992:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185489.024091:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79013ec400/0x532743011272b997 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b990 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185489.024121:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79013ec400/0x532743011272b997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b990 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185489.024134:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79013ec400/0x532743011272b997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b990 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185489.024144:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013ec400, rc 0) 00000100:00100000:1.0:1789185489.024219:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821785600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (6060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185489.024226:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789185489.024602:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821785600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185489.024619:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b997 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.024630:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b997 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185489.024699:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821785728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.024732:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185489.024761:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185489.024848:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821785728 00000100:00100000:1.0:1789185489.024866:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821785728 00000100:00100000:1.0:1789185489.024889:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789185489.024897:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821785728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185489.025286:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821785728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 388us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185489.025293:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789185489.025573:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821785728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.025605:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821785856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.025649:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185489.025672:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185489.025746:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821785856 00000100:00100000:1.0:1789185489.025750:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821785856 00000100:00100000:1.0:1789185489.025773:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789185489.025781:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821785856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185489.025938:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821785856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185489.025944:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789185489.026035:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821785856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185489.030751:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff96300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8457:1876096821785984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185489.030863:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185489.030945:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79192eaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185489.030988:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821785984 00000100:00100000:3.0:1789185489.030997:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821785984 00000100:00100000:3.0:1789185489.031054:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789185489.031064:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+15:8457:x1876096821785984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185489.031902:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+15:8457:x1876096821785984:12345-0@lo:502:llog_process_th.0 Request processed in 834us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185489.031912:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789185489.032093:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff96300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8457:1876096821785984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185489.032154:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8457:1876096821786112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185489.032197:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185489.032237:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79192eaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185489.032344:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821786112 00000100:00100000:3.0:1789185489.032350:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821786112 00000100:00100000:3.0:1789185489.032391:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789185489.032400:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+15:8457:x1876096821786112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185489.032759:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+15:8457:x1876096821786112:12345-0@lo:502:llog_process_th.0 Request processed in 360us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185489.032775:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789185489.034077:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8457:1876096821786112:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789185489.034136:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789185489.034879:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789185489.034912:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789185489.034922:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b997 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.034931:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b997 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185489.034938:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789185489.034940:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789185489.034942:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789185489.034974:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.034979:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.034986:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185489.035002:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821786240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.035059:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185489.035128:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821786240 00000100:00100000:2.0:1789185489.035135:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821786240 00000100:00100000:2.0:1789185489.035297:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789185489.035306:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+15:5820:x1876096821786240:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.035314:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14b40 going to sleep for 11 seconds 00010000:00010000:2.0:1789185489.035332:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185489.035345:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d6800/0x532743011272b9a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b99e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185489.035368:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d6800/0x532743011272b9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b99e expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185489.035380:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d6800/0x532743011272b9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b99e expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185489.035388:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6800, rc 0) 00000100:00100000:2.0:1789185489.035467:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821786240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185489.035474:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789185489.035529:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821786240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185489.035542:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9a5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.035558:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b9a5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185489.035608:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821786368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.035633:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185489.035748:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185489.035795:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821786368 00000100:00100000:3.0:1789185489.035800:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821786368 00000100:00100000:3.0:1789185489.035818:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789185489.035823:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821786368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185489.036047:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821786368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185489.036054:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789185489.036088:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821786368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.036116:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821786496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.036476:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185489.036493:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185489.036648:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821786496 00000100:00100000:3.0:1789185489.036653:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821786496 00000100:00100000:3.0:1789185489.036686:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789185489.036693:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821786496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185489.036854:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821786496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185489.036860:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789185489.036949:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821786496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185489.037298:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d02d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8458:1876096821786624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185489.037329:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185489.037352:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907e73540 going to sleep for 11 seconds 00000100:00100000:1.0:1789185489.037363:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821786624 00000100:00100000:1.0:1789185489.037367:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821786624 00000100:00100000:2.0:1789185489.037559:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789185489.037565:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+16:8458:x1876096821786624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185489.037690:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+16:8458:x1876096821786624:12345-0@lo:502:llog_process_th.0 Request processed in 124us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185489.037697:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789185489.037713:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d02d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8458:1876096821786624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789185489.037744:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185489.037752:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185489.037754:0:8458:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789185489.037761:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789185489.037790:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8458:1876096821786752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185489.037825:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185489.037895:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79192eaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185489.037925:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821786752 00000100:00100000:2.0:1789185489.037929:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821786752 00000100:00100000:2.0:1789185489.037961:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789185489.037967:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+16:8458:x1876096821786752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185489.038123:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+16:8458:x1876096821786752:12345-0@lo:502:llog_process_th.0 Request processed in 155us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185489.038136:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789185489.038284:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8458:1876096821786752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789185489.038303:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185489.038307:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185489.038309:0:8458:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789185489.038313:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1789185489.038663:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789185489.038683:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789185489.038695:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9a5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.038707:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9a5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185489.038718:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789185489.038721:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c79102db000 from 39 10000000:01000000:0.0:1789185489.038724:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789185489.038753:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.038762:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.038795:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185489.038810:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821786880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.038845:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185489.038908:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185489.038953:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821786880 00000100:00100000:3.0:1789185489.038958:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821786880 00000100:00100000:3.0:1789185489.038994:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789185489.039002:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821786880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185489.039012:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185489.039025:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe05e00/0x532743011272b9b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b9ac expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185489.039051:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe05e00/0x532743011272b9b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b9ac expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185489.039061:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe05e00/0x532743011272b9b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b9ac expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185489.039195:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05e00, rc 0) 00000100:00100000:3.0:1789185489.039278:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821786880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 276us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185489.039285:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789185489.039340:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821786880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185489.039353:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.039361:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b9b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185489.039524:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185489.039774:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821787008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.039816:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185489.039869:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185489.039910:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821787008 00000100:00100000:3.0:1789185489.039915:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821787008 00000100:00100000:3.0:1789185489.039979:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789185489.039987:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821787008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185489.040277:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821787008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185489.040283:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789185489.040358:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821787008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.040398:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821787136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.040487:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185489.043035:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185489.043355:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821787136 00000100:00100000:2.0:1789185489.043365:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821787136 00000100:00100000:2.0:1789185489.043710:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789185489.043722:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821787136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185489.044038:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821787136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 317us (3549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185489.044047:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789185489.044676:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821787136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185489.045242:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d03480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8459:1876096821787264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185489.045307:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185489.045345:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791187a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789185489.045553:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821787264 00000100:00100000:3.0:1789185489.045559:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821787264 00000100:00100000:3.0:1789185489.045602:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789185489.045611:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+17:8459:x1876096821787264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185489.045901:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+17:8459:x1876096821787264:12345-0@lo:502:llog_process_th.0 Request processed in 290us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185489.045909:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789185489.046015:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d03480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8459:1876096821787264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185489.046068:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8459:1876096821787392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185489.046124:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185489.046159:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185489.046340:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821787392 00000100:00100000:3.0:1789185489.046345:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821787392 00000100:00100000:3.0:1789185489.046388:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789185489.046395:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:8459:x1876096821787392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185489.046572:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:8459:x1876096821787392:12345-0@lo:502:llog_process_th.0 Request processed in 176us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185489.046578:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789185489.046909:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8459:1876096821787392:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789185489.046932:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789185489.047325:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789185489.047345:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789185489.047354:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185489.047365:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185489.047386:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789185489.047389:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789185489.047392:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789185489.047530:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185489.047539:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185489.047549:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185489.047566:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821787520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789185489.047604:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185489.047631:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79189d9000 going to sleep for 11 seconds 00000100:00100000:0.0:1789185489.047755:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821787520 00000100:00100000:0.0:1789185489.047761:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821787520 00000100:00100000:0.0:1789185489.047857:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789185489.047866:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821787520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185489.047877:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185489.047888:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c794216dc00/0x532743011272b9c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b9ba expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.047910:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c794216dc00/0x532743011272b9c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b9ba expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.047921:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c794216dc00/0x532743011272b9c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b9ba expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.047929:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c794216dc00, rc 0) 00000100:00100000:0.0:1789185489.047972:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821787520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185489.047978:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789185489.048042:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821787520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185489.048055:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185489.048064:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b9c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185489.048148:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821787648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185489.048175:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185489.048745:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79189d9000 going to sleep for 11 seconds 00000100:00100000:2.0:1789185489.048794:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821787648 00000100:00100000:2.0:1789185489.048800:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821787648 00000100:00100000:2.0:1789185489.048829:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789185489.048835:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821787648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185489.049194:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821787648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 357us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185489.049202:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789185489.049320:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821787648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185489.049354:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821787776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185489.049604:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185489.049664:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79189d9000 going to sleep for 11 seconds 00000100:00100000:2.0:1789185489.049699:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821787776 00000100:00100000:2.0:1789185489.049704:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821787776 00000100:00100000:2.0:1789185489.049767:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789185489.049775:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821787776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185489.049979:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821787776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185489.049986:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789185489.050061:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821787776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.050768:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8460:1876096821787904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185489.050826:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185489.050885:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14600 going to sleep for 11 seconds 00000100:00100000:1.0:1789185489.050919:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821787904 00000100:00100000:1.0:1789185489.050924:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821787904 00000100:00100000:1.0:1789185489.050990:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789185489.050998:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+18:8460:x1876096821787904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185489.051282:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+18:8460:x1876096821787904:12345-0@lo:502:llog_process_th.0 Request processed in 284us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185489.051289:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789185489.051383:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8460:1876096821787904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185489.051448:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185489.051456:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185489.051459:0:8460:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789185489.051464:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789185489.051486:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d00e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8460:1876096821788032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185489.051521:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185489.051939:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7918d5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789185489.052002:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821788032 00000100:00100000:0.0:1789185489.052006:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821788032 00000100:00100000:0.0:1789185489.052041:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789185489.052048:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:8460:x1876096821788032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185489.052234:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:8460:x1876096821788032:12345-0@lo:502:llog_process_th.0 Request processed in 186us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185489.052241:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789185489.052388:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d00e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8460:1876096821788032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185489.052436:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185489.052442:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185489.052444:0:8460:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789185489.052448:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789185489.052676:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1789185489.052693:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789185489.052703:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.052713:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185489.052723:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789185489.052726:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c7907233380 from 1 10000000:01000000:0.0:1789185489.052728:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789185489.052756:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216d400/0x532743011272b9c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.052763:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c794216d400/0x532743011272b9c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.052772:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c794216d400/0x532743011272b9c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185489.052802:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821788160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.052833:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185489.052858:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14780 going to sleep for 11 seconds 00000100:00100000:2.0:1789185489.052899:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821788160 00000100:00100000:2.0:1789185489.052903:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821788160 00000100:00100000:2.0:1789185489.052924:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789185489.052931:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821788160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185489.052941:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185489.052953:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d7e00/0x532743011272b9cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b9c8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185489.052972:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d7e00/0x532743011272b9cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b9c8 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185489.052983:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d7e00/0x532743011272b9cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b9c8 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185489.052991:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7e00, rc 0) 00000100:00100000:2.0:1789185489.053059:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821788160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185489.053075:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789185489.053294:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821788160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185489.053314:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c794216d400/0x532743011272b9c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9cf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.053323:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c794216d400/0x532743011272b9c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b9cf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185489.053363:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821788288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185489.053598:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185489.053626:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14780 going to sleep for 11 seconds 00000100:00100000:2.0:1789185489.053667:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821788288 00000100:00100000:2.0:1789185489.053672:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821788288 00000100:00100000:2.0:1789185489.053702:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789185489.053709:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821788288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185489.053945:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821788288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (346us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789185489.053953:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789185489.054023:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821788288:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789185489.054045:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789185489.054052:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216d400/0x532743011272b9c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9cf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185489.054061:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c794216d400/0x532743011272b9c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9cf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185490.063759:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185490.825779:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185490.825907:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812323456 00000100:00100000:2.0:1789185490.825921:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812323456 00000100:00100000:2.0:1789185490.826002:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 164 00000100:00100000:2.0:1789185490.826016:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+8:5614:x1876096812323456:12345-192.168.202.54@tcp:101: 00010000:00010000:2.0:1789185490.826039:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185490.826063:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d6c00/0x532743011272b9d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d3f4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185490.826101:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d6c00/0x532743011272b9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3f4 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185490.826115:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d6c00/0x532743011272b9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3f4 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185490.826126:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6c00, rc 0) 00000100:00100000:2.0:1789185490.826540:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:5614:x1876096812323456:12345-192.168.202.54@tcp:101: Request processed in 525us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185490.826550:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 164 00000100:00100000:0.0:1789185490.831948:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821788672:0@lo:400:kworker.0 00000100:00100000:0.0:1789185490.832060:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185490.832138:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789185490.832145:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821788544:0@lo:400:kworker.0 00000100:00100000:0.0:1789185490.832171:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185490.832201:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821789056:0@lo:400:kworker.0 00000100:00100000:0.0:1789185490.832228:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185490.832273:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821788672 00000100:00100000:0.0:1789185490.832300:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821788672 00000100:00100000:0.0:1789185490.832370:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821788544 00000100:00100000:0.0:1789185490.832373:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821788544 00000100:00100000:0.0:1789185490.832392:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789185490.832627:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821788672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185490.832694:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821788672:12345-0@lo:400:kworker.0 Request processed in 294us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185490.832701:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789185490.832720:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789185490.832726:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821788544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185490.832752:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821788544:12345-0@lo:400:kworker.0 Request processed in 27us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185490.832758:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789185490.832791:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821789056 00000100:00100000:0.0:1789185490.832795:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821789056 00000100:00100000:0.0:1789185490.832828:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789185490.832835:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821789056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185490.832870:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821789056:12345-0@lo:400:kworker.0 Request processed in 36us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185490.832877:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789185490.832893:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185490.832899:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185490.833016:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821788544:0@lo:400:kworker.0 00010000:00080000:0.0:1789185490.833033:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793ff94e00 x1876096821789056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185490.833043:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821789056:0@lo:400:kworker.0 00000100:00100000:0.0:1789185490.833069:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821788672:0@lo:400:kworker.0 00000100:00100000:3.0:1789185490.833190:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821788416:0@lo:400:kworker.0 00000100:00100000:3.0:1789185490.833232:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185490.833269:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821788928:0@lo:400:kworker.0 00000100:00100000:3.0:1789185490.833293:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185490.833313:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185490.833320:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821788800:0@lo:400:kworker.0 00000100:00100000:3.0:1789185490.833342:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185490.833372:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821788928 00000100:00100000:3.0:1789185490.833376:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821788928 00000100:00100000:3.0:1789185490.833438:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185490.833445:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821788928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185490.833484:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821788928:12345-0@lo:400:kworker.0 Request processed in 40us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185490.833491:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185490.833517:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821788928:0@lo:400:kworker.0 00000100:00100000:0.0:1789185490.833703:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821788800 00000100:00100000:0.0:1789185490.833707:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821788800 00000100:00100000:0.0:1789185490.833748:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789185490.833756:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821788800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185490.833808:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821788800:12345-0@lo:400:kworker.0 Request processed in 53us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185490.833814:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789185490.833829:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185490.833833:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789185490.833850:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793ff97100 x1876096821788800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185490.833861:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821788800:0@lo:400:kworker.0 00000100:00100000:0.0:1789185490.833894:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821788416 00000100:00100000:0.0:1789185490.833898:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821788416 00000100:00100000:0.0:1789185490.833933:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789185490.833941:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821788416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185490.834224:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789185490.834236:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821789184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185490.834274:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185490.834573:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821788416:12345-0@lo:400:kworker.0 Request processed in 631us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185490.834580:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789185490.834626:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821788416:0@lo:400:kworker.0 00000100:00100000:1.0:1789185490.834985:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821789184 00000100:00100000:1.0:1789185490.834992:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821789184 00000100:00100000:1.0:1789185490.835043:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185490.835053:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821789184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185490.835096:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185490.835157:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821789184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185490.835182:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789185490.835219:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907d00e00 x1876096821789184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185490.835237:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821789184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185490.844952:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185490.845087:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812323584 00000100:00100000:2.0:1789185490.845101:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812323584 00000100:00100000:2.0:1789185490.845186:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 166 00000100:00100000:2.0:1789185490.845199:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:5614:x1876096812323584:12345-192.168.202.54@tcp:501: 00000100:00100000:2.0:1789185490.845644:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:5614:x1876096812323584:12345-192.168.202.54@tcp:501: Request processed in 444us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185490.845654:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 166 00000100:00100000:3.0:1789185490.852234:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185490.852380:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812323712 00000100:00100000:0.0:1789185490.852394:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812323712 00000100:00100000:0.0:1789185490.852516:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 167 00000100:00100000:0.0:1789185490.852530:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:5614:x1876096812323712:12345-192.168.202.54@tcp:503: 00000100:00100000:0.0:1789185490.852861:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:5614:x1876096812323712:12345-192.168.202.54@tcp:503: Request processed in 332us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185490.852871:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 167 00000100:00100000:3.0:1789185490.858630:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185490.859013:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812323840 00000100:00100000:0.0:1789185490.859028:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812323840 00000100:00100000:0.0:1789185490.859104:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 168 00000100:00100000:0.0:1789185490.859118:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:6097:x1876096812323840:12345-192.168.202.54@tcp:502: 00000100:00100000:0.0:1789185490.859773:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:6097:x1876096812323840:12345-192.168.202.54@tcp:502: Request processed in 646us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185490.859785:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 168 00000100:00100000:1.0:1789185490.881624:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185490.881748:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812323968 00000100:00100000:2.0:1789185490.881763:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812323968 00000100:00100000:2.0:1789185490.881847:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 169 00000100:00100000:2.0:1789185490.881862:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:6097:x1876096812323968:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789185490.882253:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:6097:x1876096812323968:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 393us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185490.882262:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 169 00000100:00100000:3.0:1789185490.885866:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185490.886194:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812324096 00000100:00100000:0.0:1789185490.886208:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812324096 00000100:00100000:0.0:1789185490.886288:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 170 00000100:00100000:0.0:1789185490.886300:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:5614:x1876096812324096:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185490.886319:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185490.886342:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c794216c600/0x532743011272b9dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d3fb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185490.886378:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c794216c600/0x532743011272b9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3fb expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185490.886390:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c794216c600/0x532743011272b9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3fb expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185490.886441:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c794216c600, rc 0) 00000100:00100000:0.0:1789185490.886522:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5614:x1876096812324096:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 224us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185490.886550:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 170 00000100:00100000:0.0:1789185490.890634:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185490.890750:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812324224 00000100:00100000:3.0:1789185490.890774:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812324224 00000100:00100000:3.0:1789185490.890843:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:3.0:1789185490.890855:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5614:x1876096812324224:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185490.891216:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5614:x1876096812324224:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 360us (595us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789185490.891226:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 171 00010000:00010000:1.0:1789185491.087576:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185491.856036:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821789312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185491.856136:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185491.856254:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821789312 00000100:00100000:3.0:1789185491.856265:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821789312 00000100:00100000:3.0:1789185491.856342:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789185491.856353:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821789312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185491.856434:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185491.856490:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821789312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185491.856498:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789185491.856873:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907d01500 x1876096821789312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185491.856897:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821789312:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1789185492.018619:0:8497:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe89cdd490 20000000:00000080:1.0:1789185492.018646:0:8497:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c793fe54800 uarg=0000000000000000 20000000:01000000:1.0:1789185492.018701:0:8497:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789185492.018710:0:8497:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789185492.018716:0:8497:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789185492.026212:0:8498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789185492.026708:0:8497:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1789185492.034706:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1789185492.034788:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1789185492.035488:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1789185492.035521:0:8497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789185492.035548:0:8497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c79234d6200/0x532743011272b9e4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185492.035572:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7901521800/0x532743011272b759 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b752 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185492.035581:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7900030a00/0x532743011272b7bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b7b4 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185492.035605:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7901520400/0x532743011272b886 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b87f expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185492.035616:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79013ed800/0x532743011272b943 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3c3 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185492.035624:0:8497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c79234d6200/0x532743011272b9e4 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185492.035677:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79013ed800/0x532743011272b943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3c3 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185492.035702:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c79013ed800/0x532743011272b943 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3c3 expref: 9 pid: 5815 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185492.035721:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876096821789440:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789185492.037353:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7901520400/0x532743011272b886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b87f expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185492.037372:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7901520400/0x532743011272b886 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b87f expref: 18 pid: 5815 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185492.037388:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d00e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876096821789568:0@lo:104: 00000100:00100000:2.0:1789185492.037482:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789185492.037533:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7900030a00/0x532743011272b7bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b7b4 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185492.037542:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7900030a00/0x532743011272b7bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b7b4 expref: 18 pid: 5817 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185492.037574:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d02d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876096821789696:0@lo:104: 00000100:00100000:2.0:1789185492.037602:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789185492.037628:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7901521800/0x532743011272b759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b752 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185492.037637:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7901521800/0x532743011272b759 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b752 expref: 18 pid: 5817 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185492.037644:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d02680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876096821789824:0@lo:104: 00000100:00100000:2.0:1789185492.037669:0:8497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79065883c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185492.037680:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789185492.037701:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185492.037714:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821789568 00000100:00100000:0.0:1789185492.037723:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821789568 00000100:00100000:0.0:1789185492.037857:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821789696 00000100:00100000:0.0:1789185492.037862:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821789696 00000100:00100000:0.0:1789185492.037876:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821789824 00000100:00100000:0.0:1789185492.037878:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821789824 00000100:00100000:0.0:1789185492.037892:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789185492.037902:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+5:8497:x1876096821789568:12345-0@lo:104: 00010000:00010000:0.0:1789185492.037918:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7901521c00/0x532743011272b87f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b886 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185492.038277:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789185492.038285:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+5:8497:x1876096821789568:12345-0@lo:104: Request processed in 385us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185492.038293:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1789185492.038358:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185492.038367:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7901521c00/0x532743011272b87f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b886 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185492.038386:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7901521c00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185492.038391:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7901521c00/0x532743011272b87f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b886 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185492.038400:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7901521c00/0x532743011272b87f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b886 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185492.038434:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7901521c00/0x532743011272b87f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b886 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185492.038441:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789185492.038479:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1789185492.038482:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7901521c00/0x532743011272b87f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b886 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185492.038487:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f624850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+4:8497:x1876096821789696:12345-0@lo:104: 00010000:00010000:3.0:1789185492.038489:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185492.038496:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7901520e00/0x532743011272b7b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b7bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185492.038514:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7901521c00/0x532743011272b87f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b886 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185492.038521:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7901521c00/0x532743011272b87f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b886 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185492.038539:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185492.038541:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185492.038543:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185492.038556:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821789952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185492.038598:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185492.038649:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821789952 00000100:00100000:3.0:1789185492.038654:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821789952 00010000:00010000:3.0:1789185492.038677:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7901520400/0x532743011272b886 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b87f expref: 19 pid: 5815 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185492.038710:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789185492.038717:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821789952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185492.038724:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789185492.038729:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f624850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+4:8497:x1876096821789696:12345-0@lo:104: Request processed in 244us (1127us total) trans 0 rc 0/0 00010000:00010000:3.0:1789185492.038730:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185492.038736:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7901520400/0x532743011272b886 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b87f expref: 19 pid: 5815 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185492.038744:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1789185492.038746:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7901520400/0x532743011272b886 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b87f expref: 19 pid: 5815 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185492.038777:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185492.038806:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821789952:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185492.038812:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789185492.038867:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821789952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789185492.039018:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185492.039024:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7901520e00/0x532743011272b7b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b7bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185492.039043:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7901520e00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:1.0:1789185492.039046:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7901520e00/0x532743011272b7b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b7bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185492.039054:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7901520e00/0x532743011272b7b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b7bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185492.039061:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7901520e00/0x532743011272b7b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b7bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185492.039067:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789185492.039091:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7901520e00/0x532743011272b7b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b7bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185492.039094:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789185492.039101:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:8497:x1876096821789824:12345-0@lo:104: 00010000:00010000:1.0:1789185492.039103:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185492.039109:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7901521e00/0x532743011272b752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b759 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185492.039124:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7901520e00/0x532743011272b7b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b7bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185492.039132:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7901520e00/0x532743011272b7b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b7bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185492.039141:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789185492.039143:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185492.039146:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7901521e00/0x532743011272b752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b759 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185492.039146:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:8497:x1876096821789824:12345-0@lo:104: Request processed in 46us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185492.039152:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789185492.039153:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7901521e00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:1.0:1789185492.039156:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7901521e00/0x532743011272b752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b759 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185492.039163:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7901521e00/0x532743011272b752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b759 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185492.039169:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7901521e00/0x532743011272b752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b759 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185492.039185:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789185492.039191:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821790080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789185492.039199:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7901521e00/0x532743011272b752 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b759 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185492.039204:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789185492.039211:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7901521e00/0x532743011272b752 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b759 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185492.039217:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7901521e00/0x532743011272b752 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b759 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185492.039237:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185492.039239:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185492.039240:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185492.039251:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821790208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789185492.039852:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789185492.040168:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7901520400/0x532743011272b886 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b87f expref: 18 pid: 5815 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185492.040197:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d00e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876096821789568:0@lo:104: 00000100:00100000:2.0:1789185492.040210:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d02d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876096821789696:0@lo:104: 00000100:00100000:2.0:1789185492.040218:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d02680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876096821789824:0@lo:104: 00000100:00100000:3.0:1789185492.040959:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185492.040992:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821790208 00000100:00100000:3.0:1789185492.041002:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821790208 00000100:00100000:2.0:1789185492.041206:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876096821789440:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789185492.041247:0:8497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c79234d6200/0x532743011272b9e4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185492.041448:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7901521800/0x532743011272b759 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b752 expref: 18 pid: 5817 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185492.041480:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812324352 00000100:00100000:3.0:1789185492.041484:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812324352 00010000:00010000:3.0:1789185492.041502:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79013ed800/0x532743011272b943 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3c3 expref: 10 pid: 5815 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185492.041525:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789185492.041533:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:3279:x1876096821790208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185492.041572:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185492.041579:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7901521800/0x532743011272b759 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b752 expref: 18 pid: 5817 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185492.041590:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7901521800/0x532743011272b759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b752 expref: 18 pid: 5817 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185492.041610:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7901521800/0x532743011272b759 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b752 expref: 18 pid: 5817 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185492.041627:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185492.041680:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+17:3279:x1876096821790208:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (1830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185492.041688:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789185492.041708:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:3.0:1789185492.041715:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2372:x1876096812324352:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185492.041725:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185492.041730:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79013ed800/0x532743011272b943 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3c3 expref: 10 pid: 5815 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185492.041744:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79013ed800/0x532743011272b943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3c3 expref: 10 pid: 5815 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185492.041767:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79013ed800/0x532743011272b943 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3c3 expref: 10 pid: 5815 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185492.041777:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185492.042563:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:2372:x1876096812324352:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 839us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185492.042594:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00010000:00010000:3.0:1789185492.042752:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185492.045058:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185492.045285:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821790080 00000100:00100000:0.0:1789185492.045356:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821790080 00010000:00010000:0.0:1789185492.045674:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7900030a00/0x532743011272b7bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b7b4 expref: 17 pid: 5817 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185492.045715:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789185492.045726:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:3278:x1876096821790080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185492.045746:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185492.045753:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7900030a00/0x532743011272b7bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b7b4 expref: 17 pid: 5817 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185492.045828:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7900030a00/0x532743011272b7bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b7b4 expref: 17 pid: 5817 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185492.045849:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7900030a00/0x532743011272b7bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b7b4 expref: 17 pid: 5817 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185492.045910:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c79234d6200/0x532743011272b9e4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185492.045920:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d6200/0x532743011272b9e4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185492.045967:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c79234d6200/0x532743011272b9e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185492.048700:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821790208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185492.049096:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c79234d6200/0x532743011272b9e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185492.049107:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c79234d6200/0x532743011272b9e4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185492.049116:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c79234d6200/0x532743011272b9e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185492.049123:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6200 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185492.049128:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c79234d6200/0x532743011272b9e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185492.049140:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c79234d6200/0x532743011272b9e4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185492.049175:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c79234d6200/0x532743011272b9e4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185492.049196:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185492.049349:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+16:3278:x1876096821790080:12345-0@lo:103:ldlm_bl.0 Request processed in 3621us (5376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185492.049364:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1789185492.049449:0:8497:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c79234d6200/0x532743011272b9e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185492.049458:0:8497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c79234d6200/0x532743011272b9e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185492.049484:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d6200/0x532743011272b9e4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185492.050790:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821790080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789185492.111554:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185492.120643:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185492.121393:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812324480 00000100:00100000:2.0:1789185492.121442:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812324480 00000100:00100000:2.0:1789185492.121522:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 172 00000100:00100000:2.0:1789185492.121537:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:5614:x1876096812324480:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185492.121559:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185492.121584:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d6200/0x532743011272b9eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d402 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185492.121623:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d6200/0x532743011272b9eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d402 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185492.121638:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d6200/0x532743011272b9eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d402 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185492.121649:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6200, rc 0) 00000100:00100000:2.0:1789185492.121723:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5614:x1876096812324480:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 190us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185492.121730:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 172 00000100:00100000:3.0:1789185492.145587:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185492.145711:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812324608 00000100:00100000:1.0:1789185492.145725:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812324608 00000100:00100000:1.0:1789185492.145807:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 173 00000100:00100000:1.0:1789185492.145829:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5614:x1876096812324608:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185492.146217:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5614:x1876096812324608:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 399us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185492.146226:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 173 00000100:00100000:2.0:1789185492.169674:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185492.170365:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812324736 00000100:00100000:3.0:1789185492.170380:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812324736 00000100:00100000:3.0:1789185492.170488:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 174 00000100:00100000:3.0:1789185492.170502:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5614:x1876096812324736:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185492.170798:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:5614:x1876096812324736:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 298us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185492.170808:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 174 00000100:00100000:1.0:1789185492.200353:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185492.207575:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812324864 00000100:00100000:2.0:1789185492.207600:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812324864 00000100:00100000:2.0:1789185492.207672:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 175 00000100:00100000:2.0:1789185492.207685:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:6123:x1876096812324864:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789185492.208037:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:6123:x1876096812324864:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 354us (7694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185492.208058:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 175 00000100:00100000:1.0:1789185492.223890:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185492.223987:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812324992 00000100:00100000:2.0:1789185492.224001:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812324992 00000100:00100000:2.0:1789185492.224088:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 176 00000100:00100000:2.0:1789185492.224101:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:6123:x1876096812324992:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789185492.224469:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:6123:x1876096812324992:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 368us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185492.224478:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 176 00010000:00010000:0.0:1789185493.137778:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789185493.199581:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789185493.199593:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c793f2ba800 from 4 10000000:01000000:2.0:1789185493.199601:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789185493.199668:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d7a00/0x532743011272b9f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185493.199683:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79234d7a00/0x532743011272b9f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185493.200249:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79234d7a00/0x532743011272b9f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185493.200288:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821790336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.200376:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185493.200951:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906588180 going to sleep for 11 seconds 00000100:00100000:3.0:1789185493.204279:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821790336 00000100:00100000:3.0:1789185493.204299:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821790336 00000100:00100000:3.0:1789185493.204373:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789185493.204385:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821790336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185493.204421:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185493.204446:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe05400/0x532743011272b9f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272b9f2 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185493.204481:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe05400/0x532743011272b9f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272b9f2 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185493.204494:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe05400/0x532743011272b9f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b9f2 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185493.204505:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05400, rc 0) 00000100:00100000:3.0:1789185493.204609:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821790336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 226us (4233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185493.204630:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789185493.204915:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821790336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185493.204939:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79234d7a00/0x532743011272b9f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9f9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185493.204972:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79234d7a00/0x532743011272b9f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b9f9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185493.205077:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821790464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.205120:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185493.205165:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906588180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185493.205276:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821790464 00000100:00100000:0.0:1789185493.205282:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821790464 00000100:00100000:0.0:1789185493.205323:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789185493.205333:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821790464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185493.205682:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821790464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 348us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185493.205882:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821790464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.205921:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821790592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.205980:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185493.206010:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906588180 going to sleep for 11 seconds 00000100:00100000:3.0:1789185493.206108:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821790592 00000100:00100000:3.0:1789185493.206113:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821790592 00000100:00100000:3.0:1789185493.206154:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789185493.206163:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821790592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185493.206352:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821790592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185493.206360:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789185493.206586:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821790592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185493.206854:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789185493.208762:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8525:1876096821790720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185493.208869:0:8525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185493.208926:0:8525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906588e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185493.209102:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821790720 00000100:00100000:0.0:1789185493.209113:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821790720 00000100:00100000:0.0:1789185493.209171:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789185493.209183:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+17:8525:x1876096821790720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185493.209502:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+17:8525:x1876096821790720:12345-0@lo:502:llog_process_th.0 Request processed in 320us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185493.209512:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789185493.209700:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8525:1876096821790720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185493.209740:0:8525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185493.209765:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185493.209768:0:8525:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789185493.209787:0:8525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c793f2ba800 00000020:00000080:2.0:1789185493.209790:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789185493.209896:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8525:1876096821790848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185493.209940:0:8525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185493.211874:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821790848 00000100:00100000:2.0:1789185493.211892:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821790848 00000100:00100000:2.0:1789185493.212806:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789185493.212824:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:8525:x1876096821790848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185493.213275:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:8525:x1876096821790848:12345-0@lo:502:llog_process_th.0 Request processed in 456us (3334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185493.213284:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789185493.213368:0:8525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906588e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185493.213398:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8525:1876096821790848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185493.213457:0:8525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185493.213468:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185493.213471:0:8525:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789185493.213475:0:8525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789185493.214641:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789185493.214678:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789185493.214704:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d7a00/0x532743011272b9f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9f9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185493.214720:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79234d7a00/0x532743011272b9f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9f9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185493.214732:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789185493.214734:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c791f9b0000 from 4 10000000:01000000:0.0:1789185493.214738:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789185493.214794:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216d800/0x532743011272ba00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185493.214815:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c794216d800/0x532743011272ba00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185493.214828:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c794216d800/0x532743011272ba00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185493.214857:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821790976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185493.214928:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185493.217224:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906601000 going to sleep for 11 seconds 00000100:00100000:2.0:1789185493.217351:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821790976 00000100:00100000:2.0:1789185493.217364:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821790976 00000100:00100000:2.0:1789185493.217461:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789185493.217474:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821790976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185493.217496:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185493.217524:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d7000/0x532743011272ba07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272ba00 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185493.217560:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d7000/0x532743011272ba07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272ba00 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185493.217573:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d7000/0x532743011272ba07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ba00 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185493.217584:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7000, rc 0) 00000100:00100000:2.0:1789185493.217676:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821790976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (2748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185493.217707:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789185493.217788:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821790976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185493.217811:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c794216d800/0x532743011272ba00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ba07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185493.217821:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c794216d800/0x532743011272ba00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272ba07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185493.217909:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821791104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.217948:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185493.218096:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906588540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185493.218117:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821791104 00000100:00100000:2.0:1789185493.218121:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821791104 00000100:00100000:2.0:1789185493.218151:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789185493.218159:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821791104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.218504:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821791104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 344us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185493.218512:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789185493.218552:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821791104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.218592:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821791232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.218636:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185493.218650:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906588540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185493.218663:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821791232 00000100:00100000:2.0:1789185493.218667:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821791232 00000100:00100000:0.0:1789185493.218823:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789185493.218835:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821791232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185493.219036:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821791232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185493.219044:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789185493.219599:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821791232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.219867:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8528:1876096821791360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185493.219919:0:8528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185493.219947:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821791360 00000100:00100000:2.0:1789185493.219953:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821791360 00000100:00100000:2.0:1789185493.219995:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789185493.220003:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:8528:x1876096821791360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185493.220216:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:8528:x1876096821791360:12345-0@lo:502:llog_process_th.0 Request processed in 213us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185493.220224:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789185493.220266:0:8528:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185493.220279:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8528:1876096821791360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185493.220303:0:8528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185493.220315:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185493.220317:0:8528:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789185493.220326:0:8528:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c791f9b0000 00000020:00000080:2.0:1789185493.220328:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789185493.221148:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8528:1876096821791488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185493.221203:0:8528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185493.221248:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821791488 00000100:00100000:2.0:1789185493.221254:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821791488 00000100:00100000:2.0:1789185493.221294:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789185493.221303:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:8528:x1876096821791488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185493.221530:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:8528:x1876096821791488:12345-0@lo:502:llog_process_th.0 Request processed in 227us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185493.221538:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789185493.221580:0:8528:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185493.221603:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8528:1876096821791488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185493.221627:0:8528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185493.221634:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185493.221637:0:8528:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789185493.221642:0:8528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789185493.221716:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789185493.221736:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789185493.225164:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216d800/0x532743011272ba00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ba07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185493.225193:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c794216d800/0x532743011272ba00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ba07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185493.225210:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789185493.225214:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c79102db000 from 4 10000000:01000000:2.0:1789185493.225218:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789185493.225269:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d7200/0x532743011272ba0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185493.225279:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79234d7200/0x532743011272ba0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185493.225294:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79234d7200/0x532743011272ba0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185493.225327:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821791616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.225614:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185493.225662:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185493.225692:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821791616 00000100:00100000:2.0:1789185493.225701:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821791616 00000100:00100000:2.0:1789185493.225780:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789185493.225792:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821791616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185493.225809:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185493.225823:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d6a00/0x532743011272ba15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272ba0e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185493.225851:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d6a00/0x532743011272ba15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272ba0e expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185493.225862:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d6a00/0x532743011272ba15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ba0e expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185493.225872:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6a00, rc 0) 00000100:00100000:2.0:1789185493.225911:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821791616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185493.225918:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789185493.226492:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821791616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185493.226515:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79234d7200/0x532743011272ba0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ba15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185493.226527:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79234d7200/0x532743011272ba0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272ba15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185493.226606:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821791744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.226642:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185493.226662:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185493.226680:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821791744 00000100:00100000:2.0:1789185493.226684:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821791744 00000100:00100000:2.0:1789185493.226715:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789185493.226722:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821791744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.227782:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821791744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1053us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185493.227795:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789185493.227856:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821791744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.227904:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821791872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.227951:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185493.228056:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185493.228081:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821791872 00000100:00100000:2.0:1789185493.228086:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821791872 00000100:00100000:2.0:1789185493.228120:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789185493.228128:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821791872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.228307:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821791872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185493.228315:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789185493.228353:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821791872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185493.228564:0:8530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8530:1876096821792000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185493.228598:0:8530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185493.228617:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821792000 00000100:00100000:2.0:1789185493.228620:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821792000 00000100:00100000:2.0:1789185493.228644:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789185493.228650:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:8530:x1876096821792000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185493.228787:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:8530:x1876096821792000:12345-0@lo:502:llog_process_th.0 Request processed in 136us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185493.228801:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789185493.228831:0:8530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79118840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185493.228844:0:8530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8530:1876096821792000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185493.228867:0:8530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185493.228879:0:8530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185493.228882:0:8530:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789185493.228890:0:8530:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c79102db000 00000020:00000080:2.0:1789185493.228893:0:8530:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789185493.235950:0:8530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8530:1876096821792128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185493.236081:0:8530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185493.236141:0:8530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7940bdb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185493.236263:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821792128 00000100:00100000:0.0:1789185493.236273:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821792128 00000100:00100000:0.0:1789185493.236341:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789185493.236352:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:8530:x1876096821792128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185493.236701:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:8530:x1876096821792128:12345-0@lo:502:llog_process_th.0 Request processed in 350us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185493.236710:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789185493.237010:0:8530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:8530:1876096821792128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789185493.237048:0:8530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185493.237058:0:8530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185493.237061:0:8530:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789185493.237066:0:8530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789185493.237526:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789185493.237556:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185493.237569:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d7200/0x532743011272ba0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ba15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185493.237583:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79234d7200/0x532743011272ba0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ba15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185493.643610:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185493.643652:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185493.643678:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185493.643737:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185493.643794:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812325120 00000100:00100000:3.0:1789185493.643807:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812325120 00000100:00100000:3.0:1789185493.643869:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 192 00000100:00100000:3.0:1789185493.643881:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2369:x1876096812325120:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185493.644024:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2369:x1876096812325120:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 145us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185493.644032:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 192 00000100:00100000:3.0:1789185493.644074:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812325248 00000100:00100000:3.0:1789185493.644079:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812325248 00000100:00100000:3.0:1789185493.644120:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:3.0:1789185493.644127:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812325248:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185493.644708:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812325504 00000100:00100000:2.0:1789185493.644717:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812325504 00000100:00100000:2.0:1789185493.644862:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812325376 00000100:00100000:2.0:1789185493.644867:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812325376 00000100:00100000:2.0:1789185493.644900:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:2.0:1789185493.644909:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812325504:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185493.644954:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812325504:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 47us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185493.644961:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:2.0:1789185493.644977:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:2.0:1789185493.644984:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812325376:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185493.645009:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812325376:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 25us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185493.645015:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00080000:2.0:1789185493.646579:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789185493.646591:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185493.646595:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185493.650438:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812325248:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 35us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185493.650479:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00010000:00010000:2.0:1789185494.161518:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185495.183691:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185495.958023:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185495.958046:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821792256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185495.958133:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185495.958198:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821792256 00000100:00100000:2.0:1789185495.958206:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821792256 00000100:00100000:2.0:1789185495.958262:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789185495.958272:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821792256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789185495.958309:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185495.958356:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821792256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185495.958363:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789185495.958382:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789185495.958438:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907d01500 x1876096821792256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185495.958456:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821792256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185495.967300:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821792768:0@lo:400:kworker.0 00000100:00100000:1.0:1789185495.967374:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185495.967437:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789185495.967443:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821792384:0@lo:400:kworker.0 00000100:00100000:1.0:1789185495.967474:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185495.967502:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821792896:0@lo:400:kworker.0 00000100:00100000:1.0:1789185495.967528:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185495.967690:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821792512:0@lo:400:kworker.0 00000100:00100000:0.0:1789185495.967734:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185495.967755:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821793024:0@lo:400:kworker.0 00000100:00100000:0.0:1789185495.967784:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185495.967818:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821792896 00000100:00100000:0.0:1789185495.967826:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821792896 00000100:00100000:0.0:1789185495.967878:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821792512 00000100:00100000:0.0:1789185495.967881:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821792512 00000100:00100000:0.0:1789185495.967899:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789185495.967908:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821792896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185495.967960:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821792896:12345-0@lo:400:kworker.0 Request processed in 53us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185495.967967:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789185495.967983:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789185495.967989:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821792512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185495.968021:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821792512:12345-0@lo:400:kworker.0 Request processed in 31us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185495.968026:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789185495.968045:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821792768 00000100:00100000:0.0:1789185495.968049:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821792768 00000100:00100000:0.0:1789185495.968089:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821793024 00000100:00100000:0.0:1789185495.968092:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821793024 00000100:00100000:0.0:1789185495.968111:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789185495.968118:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821792768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185495.968148:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821792768:12345-0@lo:400:kworker.0 Request processed in 30us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185495.968154:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789185495.968165:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789185495.968171:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821793024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185495.968196:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821793024:12345-0@lo:400:kworker.0 Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185495.968213:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789185495.968255:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821792896:0@lo:400:kworker.0 00010000:00080000:0.0:1789185495.968269:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dc0700 x1876096821792768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185495.968279:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821792768:0@lo:400:kworker.0 00000100:00080000:0.0:1789185495.968311:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185495.968316:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185495.968331:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821792512:0@lo:400:kworker.0 00010000:00080000:0.0:1789185495.968340:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dc3800 x1876096821793024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185495.968348:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821793024:0@lo:400:kworker.0 00000100:00100000:0.0:1789185495.968526:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821792384 00000100:00100000:0.0:1789185495.968530:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821792384 00000100:00100000:0.0:1789185495.968558:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789185495.968564:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821792384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185495.968611:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821792384:12345-0@lo:400:kworker.0 Request processed in 47us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185495.968618:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789185495.968658:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821792384:0@lo:400:kworker.0 00000100:00100000:1.0:1789185495.968783:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821792640:0@lo:400:kworker.0 00000100:00100000:1.0:1789185495.968813:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185495.968851:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821792640 00000100:00100000:1.0:1789185495.968855:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821792640 00000100:00100000:1.0:1789185495.968882:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789185495.968888:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821792640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185495.968920:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821792640:12345-0@lo:400:kworker.0 Request processed in 32us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185495.968926:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789185495.968951:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821792640:0@lo:400:kworker.0 00000100:00080000:1.0:1789185495.968968:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789185496.208596:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185496.994122:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185496.994150:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821793152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185496.994229:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185496.995236:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821793152 00000100:00100000:3.0:1789185496.995248:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821793152 00000100:00100000:3.0:1789185496.996131:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789185496.996144:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821793152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185496.996184:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185496.996272:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821793152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (2042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185496.996281:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789185496.996296:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dc0a80 x1876096821793152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185496.996320:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821793152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789185497.231813:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185498.255581:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185498.761273:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185498.761434:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812325632 00000100:00100000:0.0:1789185498.761445:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812325632 00000100:00100000:0.0:1789185498.761510:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 194 00000100:00100000:0.0:1789185498.761520:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2369:x1876096812325632:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185498.766666:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2369:x1876096812325632:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 5133us (5390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185498.766682:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 194 00000100:00100000:3.0:1789185498.767243:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185498.769189:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185498.769220:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185498.769493:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812325760 00000100:00100000:1.0:1789185498.769504:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812325760 00000100:00100000:1.0:1789185498.769571:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:1.0:1789185498.769582:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2369:x1876096812325760:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185498.769669:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2369:x1876096812325760:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 88us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185498.769676:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00080000:1.0:1789185498.769714:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185498.775909:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812325888 00000100:00100000:0.0:1789185498.775924:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812325888 00000100:00100000:0.0:1789185498.775991:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812326016 00000100:00100000:0.0:1789185498.775994:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812326016 00000100:00100000:0.0:1789185498.776017:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:0.0:1789185498.776027:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812325888:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185498.776107:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812325888:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 83us (8867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185498.776115:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:0.0:1789185498.776130:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:0.0:1789185498.776136:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812326016:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185498.776154:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812326016:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 19us (6934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185498.776160:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00080000:1.0:1789185498.776605:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185498.776609:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789185498.960767:0:8796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1789185499.284569:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185500.304783:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185501.072542:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185501.072585:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821793280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185501.072688:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185501.074216:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821793280 00000100:00100000:2.0:1789185501.074232:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821793280 00000100:00080000:0.0:1789185501.074349:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185501.074817:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789185501.074832:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821793280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789185501.074884:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185501.074988:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821793280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185501.074997:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789185501.075050:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dc0a80 x1876096821793280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185501.075073:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821793280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185501.075384:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821793536:0@lo:400:kworker.0 00000100:00100000:3.0:1789185501.075456:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185501.075485:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185501.075491:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821793664:0@lo:400:kworker.0 00000100:00100000:3.0:1789185501.075512:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185501.075543:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821793536 00000100:00100000:3.0:1789185501.075549:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821793536 00000100:00100000:3.0:1789185501.075598:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821793664 00000100:00100000:3.0:1789185501.075601:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821793664 00000100:00100000:3.0:1789185501.075623:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789185501.075631:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821793536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185501.075685:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821793536:12345-0@lo:400:kworker.0 Request processed in 55us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185501.075692:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789185501.075716:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789185501.075723:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821793664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185501.075749:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821793664:12345-0@lo:400:kworker.0 Request processed in 27us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185501.075754:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789185501.075775:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185501.075795:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821793664:0@lo:400:kworker.0 00000100:00100000:3.0:1789185501.075804:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821793536:0@lo:400:kworker.0 00000100:00100000:2.0:1789185501.076690:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821793792:0@lo:400:kworker.0 00000100:00100000:2.0:1789185501.076813:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185501.076857:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789185501.076865:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821793408:0@lo:400:kworker.0 00000100:00100000:2.0:1789185501.076897:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185501.076931:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821793920:0@lo:400:kworker.0 00000100:00100000:2.0:1789185501.076956:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185501.076991:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821793792 00000100:00100000:2.0:1789185501.076998:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821793792 00000100:00100000:2.0:1789185501.077049:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789185501.077058:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821793792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185501.077502:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821793408 00000100:00100000:1.0:1789185501.077507:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821793408 00000100:00100000:1.0:1789185501.077545:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789185501.077554:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821793408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185501.077628:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821793408:12345-0@lo:400:kworker.0 Request processed in 75us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185501.077636:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789185501.077836:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821793408:0@lo:400:kworker.0 00000100:00080000:3.0:1789185501.078272:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185501.078298:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821793920 00000100:00100000:3.0:1789185501.078540:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821793920 00000100:00100000:2.0:1789185501.078737:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821793792:12345-0@lo:400:kworker.0 Request processed in 1679us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185501.078747:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789185501.079273:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789185501.079286:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821793920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185501.079362:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821793920:12345-0@lo:400:kworker.0 Request processed in 80us (2405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185501.079369:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789185501.084489:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185501.084756:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821793920:0@lo:400:kworker.0 00010000:00080000:1.0:1789185501.084784:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793fccd880 x1876096821793792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185501.084796:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821793792:0@lo:400:kworker.0 00010000:00010000:3.0:1789185501.328580:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185502.112325:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821794048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185502.112458:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185502.112562:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821794048 00000100:00100000:0.0:1789185502.112572:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821794048 00000100:00100000:0.0:1789185502.112635:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789185502.112646:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821794048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789185502.112710:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789185502.112767:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821794048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185502.112775:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1789185502.112827:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793ff94700 x1876096821794048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185502.112849:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821794048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789185502.352133:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185503.375642:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185503.892374:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185503.892461:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185503.892483:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185503.892533:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185503.892560:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812326400 00000100:00100000:1.0:1789185503.892569:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812326400 00000100:00100000:1.0:1789185503.892620:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812326528 00000100:00100000:1.0:1789185503.892624:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812326528 00000100:00100000:1.0:1789185503.892658:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789185503.892668:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2368:x1876096812326400:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:1.0:1789185503.892704:0:6678:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b951 00000100:00080000:1.0:1789185503.892716:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9c78011b1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789185503.892752:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789185503.893176:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+2:2368:x1876096812326400:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 430us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185503.893185:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789185503.893201:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1789185503.893208:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2368:x1876096812326528:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:1.0:1789185503.893223:0:6678:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b958 00000100:00080000:1.0:1789185503.893229:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9c78011b2000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789185503.893249:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789185503.893461:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+2:2368:x1876096812326528:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 252us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185503.893468:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00080000:1.0:1789185503.893487:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185503.893490:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789185503.893549:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185503.895603:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812326144 00000100:00100000:3.0:1789185503.895617:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812326144 00000100:00100000:3.0:1789185503.895688:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 196 00000100:00100000:3.0:1789185503.895699:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2369:x1876096812326144:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185503.895763:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2369:x1876096812326144:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 65us (3396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185503.895770:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 196 00000100:00100000:3.0:1789185503.895804:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812326272 00000100:00100000:3.0:1789185503.895809:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812326272 00000100:00100000:3.0:1789185503.895849:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:3.0:1789185503.895856:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2369:x1876096812326272:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185503.895885:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2369:x1876096812326272:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 30us (3425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185503.895891:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00010000:00010000:3.0:1789185503.896045:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789185503.897459:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789185504.404684:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789185504.552220:0:9040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing yml_node 00010000:00010000:2.0:1789185505.423754:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789185505.758763:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000020:00000080:0.0:1789185505.758772:0:6703:0:(genops.c:885:class_export_put()) final put ffff9c78011b4800/19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000020:00000080:0.0:1789185505.758797:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c78011b4800/19bfb1a3-97ed-41fd-ac10-946cffd5be7d for lustre-OST0000 00000020:00000080:0.0:1789185505.758850:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c78011b1800 for lustre-OST0000 00000100:00100000:2.0:1789185506.192214:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789185506.192240:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821794176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185506.192322:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185506.192687:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821794176 00000100:00100000:3.0:1789185506.192697:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821794176 00000100:00100000:3.0:1789185506.192767:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789185506.192778:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821794176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185506.192814:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185506.192864:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821794176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185506.192870:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789185506.192987:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789185506.193020:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907c15880 x1876096821794176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185506.193039:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821794176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185506.193217:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821794688:0@lo:400:kworker.0 00000100:00100000:0.0:1789185506.193267:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185506.193291:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185506.193297:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821794560:0@lo:400:kworker.0 00000100:00100000:0.0:1789185506.193323:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185506.193349:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821794688 00000100:00100000:0.0:1789185506.193353:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821794688 00000100:00100000:0.0:1789185506.193394:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789185506.193401:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f12b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821794688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185506.193465:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f12b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821794688:12345-0@lo:400:kworker.0 Request processed in 64us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185506.193471:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789185506.193502:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f129880 x1876096821794688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185506.193513:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821794688:0@lo:400:kworker.0 00000100:00100000:1.0:1789185506.193647:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821794304:0@lo:400:kworker.0 00000100:00100000:1.0:1789185506.193681:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185506.193713:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f12a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821794816:0@lo:400:kworker.0 00000100:00100000:1.0:1789185506.193735:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185506.193751:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185506.193756:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821794432:0@lo:400:kworker.0 00000100:00100000:1.0:1789185506.193776:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185506.193901:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821794304 00000100:00100000:0.0:1789185506.193906:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821794304 00000100:00100000:2.0:1789185506.193998:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821794560 00000100:00100000:2.0:1789185506.194003:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821794560 00000100:00100000:2.0:1789185506.194026:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821794816 00000100:00100000:2.0:1789185506.194029:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821794816 00000100:00100000:2.0:1789185506.194043:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821794432 00000100:00100000:2.0:1789185506.194045:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821794432 00000100:00100000:2.0:1789185506.194069:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789185506.194076:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821794560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185506.194121:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821794560:12345-0@lo:400:kworker.0 Request processed in 46us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185506.194127:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789185506.194140:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789185506.194146:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821794816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185506.194179:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821794816:12345-0@lo:400:kworker.0 Request processed in 33us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185506.194184:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789185506.194195:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789185506.194200:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821794432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185506.194225:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821794432:12345-0@lo:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185506.194242:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1789185506.194266:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789185506.194270:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185506.194290:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821794432:0@lo:400:kworker.0 00000100:00100000:2.0:1789185506.194299:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f12a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821794816:0@lo:400:kworker.0 00000100:00100000:2.0:1789185506.194322:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821794560:0@lo:400:kworker.0 00000100:00100000:0.0:1789185506.195437:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789185506.195455:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821794304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185506.195520:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821794304:12345-0@lo:400:kworker.0 Request processed in 73us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185506.195526:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789185506.195632:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821794304:0@lo:400:kworker.0 00010000:00010000:0.0:1789185506.449440:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185507.216516:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821794944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185507.216592:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185507.217117:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821794944 00000100:00100000:0.0:1789185507.217126:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821794944 00000100:00100000:0.0:1789185507.217191:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789185507.217200:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821794944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789185507.217236:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789185507.217293:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821794944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185507.217299:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789185507.217338:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f129880 x1876096821794944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185507.217379:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821794944:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789185507.472122:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789185508.335174:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000020:00000080:1.0:1789185508.335187:0:7633:0:(genops.c:885:class_export_put()) final put ffff9c78011b7000/19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000020:00000080:2.0:1789185508.335323:0:486:0:(genops.c:844:class_export_destroy()) destroying export ffff9c78011b7000/19bfb1a3-97ed-41fd-ac10-946cffd5be7d for lustre-OST0001 00000020:00000080:2.0:1789185508.335387:0:486:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c78011b2000 for lustre-OST0001 00010000:00010000:2.0:1789185508.499367:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789185508.917396:0:9234:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.40 00000100:00100000:1.0:1789185509.004463:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185509.004518:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185509.004584:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812326656 00000100:00100000:1.0:1789185509.004606:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812326656 00000100:00100000:1.0:1789185509.004669:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 198 00000100:00100000:1.0:1789185509.004681:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2372:x1876096812326656:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185509.004935:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2372:x1876096812326656:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 254us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185509.004945:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 198 00000100:00100000:3.0:1789185509.005312:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812326784 00000100:00100000:3.0:1789185509.005319:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812326784 00000100:00100000:3.0:1789185509.005378:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:3.0:1789185509.005386:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812326784:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185509.005504:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812326784:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 118us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185509.005512:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00080000:1.0:1789185509.007264:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789185509.522335:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185510.548030:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185511.312584:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821795072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185511.312683:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185511.312818:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821795072 00000100:00100000:0.0:1789185511.312830:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821795072 00000100:00100000:0.0:1789185511.312926:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789185511.312939:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821795072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185511.312986:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789185511.313040:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821795072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185511.313047:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789185511.313115:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789185511.313152:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907c16a00 x1876096821795072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185511.313175:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821795072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185511.313524:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821795328:0@lo:400:kworker.0 00000100:00100000:1.0:1789185511.313566:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185511.313607:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185511.313613:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821795456:0@lo:400:kworker.0 00000100:00100000:1.0:1789185511.313638:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185511.313670:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821795328 00000100:00100000:1.0:1789185511.313675:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821795328 00000100:00100000:1.0:1789185511.313710:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821795456 00000100:00100000:1.0:1789185511.313714:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821795456 00000100:00100000:1.0:1789185511.313735:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789185511.313741:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821795328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185511.313783:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821795328:12345-0@lo:400:kworker.0 Request processed in 42us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185511.313789:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789185511.313804:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789185511.313811:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821795456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185511.313837:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821795456:12345-0@lo:400:kworker.0 Request processed in 27us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185511.313842:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789185511.313898:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821795456:0@lo:400:kworker.0 00000100:00100000:1.0:1789185511.313908:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821795328:0@lo:400:kworker.0 00000100:00100000:0.0:1789185511.313993:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821795584:0@lo:400:kworker.0 00000100:00100000:0.0:1789185511.314028:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185511.314057:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789185511.314063:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821795200:0@lo:400:kworker.0 00000100:00100000:0.0:1789185511.314094:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185511.314119:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821795712:0@lo:400:kworker.0 00000100:00100000:0.0:1789185511.314140:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185511.314174:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821795200 00000100:00100000:0.0:1789185511.314178:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821795200 00000100:00100000:0.0:1789185511.314205:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789185511.314211:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821795200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185511.314250:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821795200:12345-0@lo:400:kworker.0 Request processed in 39us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185511.314255:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789185511.314285:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821795200:0@lo:400:kworker.0 00000100:00080000:2.0:1789185511.314372:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185511.314906:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821795584 00000100:00100000:1.0:1789185511.314914:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821795584 00000100:00100000:1.0:1789185511.314974:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789185511.314983:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821795584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185511.315041:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821795584:12345-0@lo:400:kworker.0 Request processed in 60us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185511.315048:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789185511.315089:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907c17b80 x1876096821795584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185511.315102:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821795584:0@lo:400:kworker.0 00000100:00100000:1.0:1789185511.315120:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821795712 00000100:00100000:1.0:1789185511.315124:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821795712 00000100:00100000:1.0:1789185511.315151:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789185511.315157:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821795712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185511.315193:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821795712:12345-0@lo:400:kworker.0 Request processed in 35us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185511.315199:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789185511.315227:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821795712:0@lo:400:kworker.0 00000100:00080000:2.0:1789185511.316659:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789185511.316668:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789185511.575976:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789185511.748946:0:9332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.40 00000100:00100000:1.0:1789185512.339075:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185512.339392:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821795840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185512.339668:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185512.339802:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821795840 00000100:00100000:2.0:1789185512.339813:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821795840 00000100:00100000:2.0:1789185512.339881:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789185512.339893:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821795840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185512.339943:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185512.340000:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821795840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185512.340008:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789185512.340059:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907c14380 x1876096821795840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185512.340093:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821795840:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789185512.592447:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185513.615656:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185514.128811:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185514.128863:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185514.128901:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812327040 00000100:00100000:1.0:1789185514.128913:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812327040 00000100:00100000:1.0:1789185514.128976:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:1.0:1789185514.128986:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2371:x1876096812327040:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185514.129058:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2371:x1876096812327040:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 73us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185514.129065:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00080000:1.0:1789185514.129086:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185514.129515:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812326912 00000100:00100000:0.0:1789185514.129521:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812326912 00000100:00100000:0.0:1789185514.129573:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00100000:0.0:1789185514.129582:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2371:x1876096812326912:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185514.129622:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2371:x1876096812326912:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 41us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185514.129629:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 200 00000001:02000400:0.0:1789185514.279745:0:9430:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.40 00010000:00010000:2.0:1789185514.642081:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185515.663709:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789185515.880985:0:9478:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 23:58:33 EDT 2026 00000100:00100000:2.0:1789185516.433182:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821795968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185516.433290:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185516.433865:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821795968 00000100:00100000:0.0:1789185516.433880:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821795968 00000100:00100000:0.0:1789185516.433995:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789185516.434009:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821795968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185516.434064:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789185516.434473:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185516.434503:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789185516.434520:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821796096:0@lo:400:kworker.0 00000100:00100000:1.0:1789185516.435008:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185516.435101:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821796096 00000100:00100000:1.0:1789185516.435107:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821796096 00000100:00100000:1.0:1789185516.435154:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789185516.435163:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3279:x1876096821796096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185516.435208:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3279:x1876096821796096:12345-0@lo:400:kworker.0 Request processed in 46us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185516.435217:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789185516.435277:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821796096:0@lo:400:kworker.0 00000100:00100000:1.0:1789185516.435622:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821796224:0@lo:400:kworker.0 00000100:00100000:1.0:1789185516.435655:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185516.435691:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821796224 00000100:00100000:1.0:1789185516.435695:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821796224 00000100:00100000:1.0:1789185516.435726:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789185516.435733:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821796224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185516.435792:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821796224:12345-0@lo:400:kworker.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185516.435799:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789185516.435832:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821796224:0@lo:400:kworker.0 00000100:00100000:1.0:1789185516.435865:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821796352:0@lo:400:kworker.0 00000100:00100000:1.0:1789185516.435890:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185516.435919:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821796352 00000100:00100000:1.0:1789185516.435923:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821796352 00000100:00100000:1.0:1789185516.435955:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789185516.435962:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821796352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185516.435997:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821796352:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185516.436003:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1789185516.436018:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185516.436036:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821796352:0@lo:400:kworker.0 00000100:00100000:0.0:1789185516.451419:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821795968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17380us (18097us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185516.451448:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789185516.453544:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907c15f80 x1876096821795968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185516.453586:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821795968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185516.455215:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185516.455236:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1876096821796608:0@lo:400:kworker.0 00000100:00100000:3.0:1789185516.455524:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185516.455600:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821796608 00000100:00100000:3.0:1789185516.455608:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821796608 00000100:00100000:3.0:1789185516.455684:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789185516.455694:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876096821796608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185516.455760:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876096821796608:12345-0@lo:400:kworker.0 Request processed in 67us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185516.455767:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789185516.455791:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185516.455829:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1876096821796608:0@lo:400:kworker.0 00000100:00100000:2.0:1789185516.456698:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821796480:0@lo:400:kworker.0 00000100:00100000:2.0:1789185516.456757:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185516.456876:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821796480 00000100:00100000:0.0:1789185516.456883:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821796480 00000100:00100000:0.0:1789185516.457012:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789185516.457022:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821796480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185516.457373:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821796480:12345-0@lo:400:kworker.0 Request processed in 52us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185516.457384:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789185516.457646:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789185516.457684:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793fccd880 x1876096821796480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185516.457701:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821796480:0@lo:400:kworker.0 00010000:00010000:2.0:1789185516.690209:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185517.459781:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821796736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185517.459881:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185517.460014:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821796736 00000100:00100000:1.0:1789185517.460026:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821796736 00000100:00100000:1.0:1789185517.460094:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789185517.460108:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821796736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789185517.460167:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185517.460235:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821796736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185517.460243:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789185517.460474:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907c15180 x1876096821796736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185517.460499:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821796736:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789185517.712670:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185518.736581:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185519.246877:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185519.246942:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185519.246980:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812327296 00000100:00100000:2.0:1789185519.246981:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812327168 00000100:00100000:3.0:1789185519.246992:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812327296 00000100:00100000:2.0:1789185519.246992:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812327168 00000100:00100000:2.0:1789185519.247056:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 202 00000100:00100000:3.0:1789185519.247060:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:3.0:1789185519.247069:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812327296:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185519.247069:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2372:x1876096812327168:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185519.248319:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812327296:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 1243us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185519.248334:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00080000:3.0:1789185519.248381:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185519.248921:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2372:x1876096812327168:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 1851us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185519.248933:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 202 00010000:00010000:1.0:1789185519.759833:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185520.796818:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185521.555717:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821796992:0@lo:400:kworker.0 00000100:00100000:1.0:1789185521.555822:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185521.555883:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821797504:0@lo:400:kworker.0 00000100:00100000:1.0:1789185521.555906:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185521.555933:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789185521.555937:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821796864:0@lo:400:kworker.0 00000100:00100000:1.0:1789185521.555957:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185521.555971:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821797376:0@lo:400:kworker.0 00000100:00100000:1.0:1789185521.555983:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185521.556003:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821797120:0@lo:400:kworker.0 00000100:00100000:1.0:1789185521.556037:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185521.556062:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185521.556068:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821797248:0@lo:400:kworker.0 00000100:00100000:1.0:1789185521.556090:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185521.556133:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821796992 00000100:00100000:1.0:1789185521.556147:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821796992 00000100:00100000:1.0:1789185521.556194:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821797376 00000100:00100000:1.0:1789185521.556197:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821797376 00000100:00100000:1.0:1789185521.556219:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821797120 00000100:00100000:1.0:1789185521.556221:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821797120 00000100:00100000:1.0:1789185521.556233:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789185521.556240:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821796992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185521.556611:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821796992:12345-0@lo:400:kworker.0 Request processed in 368us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185521.556621:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789185521.556643:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789185521.556648:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821797376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185521.556679:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821797376:12345-0@lo:400:kworker.0 Request processed in 32us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185521.556684:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789185521.556692:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789185521.556696:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821797120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185521.556715:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821797120:12345-0@lo:400:kworker.0 Request processed in 20us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185521.556719:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789185521.556733:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821797504 00000100:00100000:1.0:1789185521.556735:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821797504 00000100:00100000:1.0:1789185521.556757:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821797248 00000100:00100000:1.0:1789185521.556759:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821797248 00000100:00100000:1.0:1789185521.556774:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789185521.556780:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821797504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185521.556812:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821797504:12345-0@lo:400:kworker.0 Request processed in 33us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185521.556818:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789185521.556830:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789185521.556836:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821797248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185521.556856:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821797248:12345-0@lo:400:kworker.0 Request processed in 22us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185521.556860:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789185521.556874:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821796864 00000100:00100000:1.0:1789185521.556876:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821796864 00000100:00100000:1.0:1789185521.556895:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789185521.556899:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821796864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185521.556929:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821796864:12345-0@lo:400:kworker.0 Request processed in 30us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185521.556933:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1789185521.556966:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185521.556970:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185521.556972:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789185521.557003:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907c15180 x1876096821797248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185521.557015:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821797248:0@lo:400:kworker.0 00000100:00100000:1.0:1789185521.557023:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821797120:0@lo:400:kworker.0 00000100:00100000:0.0:1789185521.557104:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821796864:0@lo:400:kworker.0 00000100:00100000:0.0:1789185521.557133:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821797376:0@lo:400:kworker.0 00000100:00100000:0.0:1789185521.557146:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821796992:0@lo:400:kworker.0 00010000:00080000:0.0:1789185521.557153:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907c14380 x1876096821797504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185521.557159:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821797504:0@lo:400:kworker.0 00000100:00100000:2.0:1789185521.575026:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821797632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185521.575150:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185521.575553:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821797632 00000100:00100000:1.0:1789185521.575565:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821797632 00000100:00100000:1.0:1789185521.575637:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789185521.575649:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821797632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185521.575699:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185521.575775:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821797632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185521.575783:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789185521.576047:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f17d500 x1876096821797632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185521.576070:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821797632:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789185521.808552:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185522.578267:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185522.578298:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821797760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185522.578384:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185522.578797:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821797760 00000100:00100000:2.0:1789185522.578806:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821797760 00000100:00100000:2.0:1789185522.578859:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789185522.578868:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821797760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185522.578907:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185522.578958:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821797760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185522.578964:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789185522.579656:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907d00700 x1876096821797760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185522.579680:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821797760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789185522.832557:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185523.855567:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185524.365586:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185524.365814:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812327424 00000100:00100000:1.0:1789185524.365833:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185524.365840:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812327424 00000100:00100000:2.0:1789185524.365928:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 204 00000100:00100000:2.0:1789185524.365943:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2371:x1876096812327424:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185524.366049:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2371:x1876096812327424:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 110us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185524.366059:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 204 00000100:00100000:3.0:1789185524.366084:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812327552 00000100:00100000:3.0:1789185524.366106:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812327552 00000100:00100000:3.0:1789185524.366196:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:3.0:1789185524.366207:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2371:x1876096812327552:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185524.366282:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2371:x1876096812327552:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 76us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185524.366291:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00080000:2.0:1789185524.366438:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789185524.880000:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185525.903724:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185526.671704:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185526.671729:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821797888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185526.671803:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185526.671908:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821797888 00000100:00100000:1.0:1789185526.671917:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821797888 00000100:00100000:1.0:1789185526.671977:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789185526.671997:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821797888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185526.672034:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185526.672093:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821797888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185526.672102:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789185526.672217:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789185526.672249:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f17dc00 x1876096821797888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185526.672267:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821797888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185526.675351:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821798144:0@lo:400:kworker.0 00000100:00100000:1.0:1789185526.675472:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185526.675514:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185526.675521:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821798272:0@lo:400:kworker.0 00000100:00100000:1.0:1789185526.675544:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185526.675570:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821798144 00000100:00100000:1.0:1789185526.675576:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821798144 00000100:00100000:1.0:1789185526.675610:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821798272 00000100:00100000:1.0:1789185526.675612:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821798272 00000100:00100000:1.0:1789185526.675629:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789185526.675635:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821798144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185526.675672:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821798144:12345-0@lo:400:kworker.0 Request processed in 37us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185526.675676:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789185526.675689:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789185526.675692:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821798272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185526.675706:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821798272:12345-0@lo:400:kworker.0 Request processed in 14us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185526.675710:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789185526.675735:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821798272:0@lo:400:kworker.0 00000100:00100000:1.0:1789185526.675742:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821798144:0@lo:400:kworker.0 00000100:00080000:1.0:1789185526.675771:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185526.675778:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821798016:0@lo:400:kworker.0 00000100:00100000:1.0:1789185526.675800:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185526.675816:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821798528:0@lo:400:kworker.0 00000100:00100000:1.0:1789185526.675828:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185526.675836:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185526.675839:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821798400:0@lo:400:kworker.0 00000100:00100000:1.0:1789185526.675853:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185526.675871:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821798016 00000100:00100000:1.0:1789185526.675874:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821798016 00000100:00100000:1.0:1789185526.675890:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789185526.675894:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821798016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185526.675917:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821798016:12345-0@lo:400:kworker.0 Request processed in 22us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185526.675923:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789185526.675947:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821798528 00000100:00100000:1.0:1789185526.675951:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821798528 00000100:00100000:1.0:1789185526.675974:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789185526.675980:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821798528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185526.676005:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821798528:12345-0@lo:400:kworker.0 Request processed in 25us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185526.676011:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789185526.676028:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821798400 00000100:00100000:1.0:1789185526.676032:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821798400 00000100:00100000:1.0:1789185526.676057:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789185526.676063:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821798400:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789185526.676468:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185526.676473:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185526.676492:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821798016:0@lo:400:kworker.0 00000100:00100000:0.0:1789185526.676501:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821798528:0@lo:400:kworker.0 00000100:00100000:1.0:1789185526.678249:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821798400:12345-0@lo:400:kworker.0 Request processed in 2183us (2391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185526.678260:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789185526.678448:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f17f800 x1876096821798400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185526.678463:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821798400:0@lo:400:kworker.0 00010000:00010000:1.0:1789185526.929936:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185527.699630:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821798656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185527.699705:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185527.699808:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821798656 00000100:00100000:2.0:1789185527.699817:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821798656 00000100:00100000:2.0:1789185527.699870:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789185527.699881:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821798656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185527.699920:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185527.699970:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821798656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185527.699977:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1789185527.700018:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907d03100 x1876096821798656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185527.700037:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821798656:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789185527.951540:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185528.976243:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185529.478978:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185529.479029:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185529.479170:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812327680 00000100:00100000:2.0:1789185529.479181:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812327680 00000100:00100000:2.0:1789185529.479241:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 206 00000100:00100000:2.0:1789185529.479253:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2370:x1876096812327680:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185529.479329:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2370:x1876096812327680:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 77us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185529.479336:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 206 00000100:00100000:0.0:1789185529.480624:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812327808 00000100:00100000:0.0:1789185529.480637:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812327808 00000100:00100000:0.0:1789185529.480703:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:0.0:1789185529.480713:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812327808:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185529.480790:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812327808:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 78us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185529.480812:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00080000:0.0:1789185529.480837:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789185530.000672:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185531.023535:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185531.791953:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821799040:0@lo:400:kworker.0 00000100:00100000:0.0:1789185531.792128:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185531.792192:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789185531.792199:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821798912:0@lo:400:kworker.0 00000100:00100000:0.0:1789185531.792227:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185531.792244:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f12a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821799424:0@lo:400:kworker.0 00000100:00100000:0.0:1789185531.792266:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185531.792306:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821799040 00000100:00100000:0.0:1789185531.792313:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821799040 00000100:00100000:0.0:1789185531.792359:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821798912 00000100:00100000:0.0:1789185531.792362:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821798912 00000100:00100000:0.0:1789185531.792377:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789185531.792402:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821799040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185531.792492:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821799040:12345-0@lo:400:kworker.0 Request processed in 106us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185531.792500:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789185531.792515:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789185531.792522:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821798912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185531.792547:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821798912:12345-0@lo:400:kworker.0 Request processed in 26us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185531.792552:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789185531.792573:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821799424 00000100:00100000:0.0:1789185531.792577:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821799424 00000100:00100000:0.0:1789185531.792604:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789185531.792611:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821799424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185531.792639:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821799424:12345-0@lo:400:kworker.0 Request processed in 29us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185531.792645:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789185531.792668:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185531.792673:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185531.792747:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821798912:0@lo:400:kworker.0 00010000:00080000:0.0:1789185531.792759:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f12a680 x1876096821799424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185531.792769:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f12a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821799424:0@lo:400:kworker.0 00000100:00100000:0.0:1789185531.792777:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821799040:0@lo:400:kworker.0 00000100:00100000:2.0:1789185531.793220:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f12bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821799168:0@lo:400:kworker.0 00000100:00100000:2.0:1789185531.793257:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185531.793282:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789185531.793289:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821798784:0@lo:400:kworker.0 00000100:00100000:2.0:1789185531.793315:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185531.793339:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821799296:0@lo:400:kworker.0 00000100:00100000:2.0:1789185531.793361:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185531.793401:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821799168 00000100:00100000:2.0:1789185531.793423:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821799168 00000100:00100000:2.0:1789185531.793458:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789185531.793464:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821799168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185531.793501:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821799168:12345-0@lo:400:kworker.0 Request processed in 37us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185531.793508:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789185531.793527:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821798784 00000100:00100000:2.0:1789185531.793530:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821798784 00000100:00100000:2.0:1789185531.793552:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789185531.793571:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821798784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185531.793598:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821798784:12345-0@lo:400:kworker.0 Request processed in 40us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185531.793604:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789185531.793635:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821798784:0@lo:400:kworker.0 00010000:00080000:2.0:1789185531.793646:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f12bb80 x1876096821799168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185531.793655:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f12bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821799168:0@lo:400:kworker.0 00000100:00080000:2.0:1789185531.793685:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185531.794353:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185531.794366:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821799552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185531.794435:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185531.794481:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821799552 00000100:00100000:1.0:1789185531.794486:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821799552 00000100:00100000:1.0:1789185531.794517:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789185531.794524:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821799552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185531.794554:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185531.794606:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821799552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185531.794613:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789185531.794646:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f17fb80 x1876096821799552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185531.794662:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821799552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185531.794711:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821799296 00000100:00100000:1.0:1789185531.794716:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821799296 00000100:00100000:1.0:1789185531.794755:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789185531.794762:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821799296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185531.794797:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821799296:12345-0@lo:400:kworker.0 Request processed in 35us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185531.794803:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789185531.795249:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185531.795272:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821799296:0@lo:400:kworker.0 00010000:00010000:1.0:1789185532.047891:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185532.816721:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185532.816752:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821799680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185532.816844:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185532.817460:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821799680 00000100:00100000:1.0:1789185532.817472:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821799680 00000100:00100000:1.0:1789185532.817532:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789185532.817543:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821799680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789185532.817846:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185532.818505:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821799680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 961us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185532.818514:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789185532.818858:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907d00700 x1876096821799680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185532.818884:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821799680:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789185533.071631:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185534.098244:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185534.603436:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185534.603506:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185534.603551:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812327936 00000100:00100000:1.0:1789185534.603564:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812327936 00000100:00100000:1.0:1789185534.603638:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 208 00000100:00100000:1.0:1789185534.603651:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2370:x1876096812327936:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185534.603739:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2370:x1876096812327936:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 91us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185534.603748:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 208 00000100:00100000:0.0:1789185534.603910:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812328064 00000100:00100000:0.0:1789185534.603915:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812328064 00000100:00100000:0.0:1789185534.603972:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:0.0:1789185534.603981:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812328064:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185534.604032:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812328064:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 53us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185534.604038:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00080000:1.0:1789185534.604136:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1789185534.901721:0:10108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:58:52 (1789185532) === 00010000:00010000:1.0:1789185535.132628:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185535.424242:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185535.430030:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812328192 00000100:00100000:2.0:1789185535.430045:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812328192 00000100:00100000:2.0:1789185535.430129:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 209 00000100:00100000:2.0:1789185535.430139:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:8154:x1876096812328192:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789185535.430156:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185535.430176:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d6e00/0x532743011272ba1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d409 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185535.430204:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d6e00/0x532743011272ba1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d409 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185535.430216:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d6e00/0x532743011272ba1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d409 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185535.430225:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6e00, rc 0) 00000100:00100000:2.0:1789185535.430295:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:8154:x1876096812328192:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 158us (6064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185535.430302:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 209 00000100:00100000:2.0:1789185535.438266:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185535.439136:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812328320 00000100:00100000:0.0:1789185535.439148:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812328320 00000100:00100000:0.0:1789185535.439203:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 210 00000100:00100000:0.0:1789185535.439213:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:8154:x1876096812328320:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789185535.442190:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:8154:x1876096812328320:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 2967us (3923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185535.442205:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 210 00000100:00100000:3.0:1789185535.455946:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185535.471880:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812328448 00000100:00100000:1.0:1789185535.471896:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812328448 00000100:00100000:1.0:1789185535.472236:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 211 00000100:00100000:1.0:1789185535.472248:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:8154:x1876096812328448:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789185535.472587:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:8154:x1876096812328448:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 340us (16736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185535.472596:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 211 00000100:00100000:1.0:1789185535.481215:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185535.481523:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812328576 00000100:00100000:0.0:1789185535.481534:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812328576 00000100:00100000:0.0:1789185535.481640:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:0.0:1789185535.481652:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:8158:x1876096812328576:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789185535.481962:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:8158:x1876096812328576:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 312us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185535.481971:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:0.0:1789185535.523211:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185535.523627:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812328704 00000100:00100000:3.0:1789185535.523639:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812328704 00000100:00100000:3.0:1789185535.523755:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 213 00000100:00100000:3.0:1789185535.523767:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:8158:x1876096812328704:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789185535.524176:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:8158:x1876096812328704:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 411us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185535.524185:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 213 00000100:00100000:3.0:1789185535.561465:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185535.561631:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812328832 00000100:00100000:0.0:1789185535.561642:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812328832 00000100:00100000:0.0:1789185535.561706:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 214 00000100:00100000:0.0:1789185535.561715:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:8154:x1876096812328832:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789185535.561730:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185535.561748:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7907354800/0x532743011272ba23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d433 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185535.561779:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7907354800/0x532743011272ba23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d433 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185535.561790:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7907354800/0x532743011272ba23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d433 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185535.561799:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354800, rc 0) 00000100:00100000:0.0:1789185535.561875:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:8154:x1876096812328832:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 161us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185535.561882:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 214 00000100:00100000:2.0:1789185535.567518:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185535.568257:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812328960 00000100:00100000:3.0:1789185535.568270:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812328960 00000100:00100000:3.0:1789185535.568340:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 215 00000100:00100000:3.0:1789185535.568359:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:8154:x1876096812328960:12345-192.168.202.54@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789185535.568394:0:5816:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789185535.568449:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789185535.568454:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789185535.568457:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789185535.568459:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789185535.573770:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:8154:x1876096812328960:12345-192.168.202.54@tcp:256:mount.lustre.0 Request processed in 5410us (6252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185535.573800:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 215 00000100:00100000:3.0:1789185535.593865:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185535.596630:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812329088 00000100:00100000:2.0:1789185535.596646:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812329088 00000100:00100000:2.0:1789185535.596711:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 216 00000100:00100000:2.0:1789185535.596722:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:8154:x1876096812329088:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789185535.596754:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185535.596774:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d6000/0x532743011272ba2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d43a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185535.596801:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d6000/0x532743011272ba2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d43a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185535.596813:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d6000/0x532743011272ba2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d43a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185535.596822:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6000, rc 0) 00000100:00100000:2.0:1789185535.596899:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:8154:x1876096812329088:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 178us (3047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185535.596907:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 216 00000100:00100000:2.0:1789185535.603658:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185535.603755:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812329216 00000100:00100000:3.0:1789185535.603765:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812329216 00000100:00100000:3.0:1789185535.603823:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 217 00000100:00100000:3.0:1789185535.603834:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:8154:x1876096812329216:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789185535.604165:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:8154:x1876096812329216:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 331us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185535.604174:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 217 00000100:00100000:3.0:1789185535.610587:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185535.610790:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812329344 00000100:00100000:0.0:1789185535.610804:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812329344 00000100:00100000:0.0:1789185535.610874:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 218 00000100:00100000:0.0:1789185535.610887:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:8154:x1876096812329344:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789185535.611219:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:8154:x1876096812329344:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 334us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185535.611229:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 218 00000100:00100000:1.0:1789185535.623221:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185535.624301:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812329472 00000100:00100000:2.0:1789185535.624316:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812329472 00000100:00100000:2.0:1789185535.624444:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:2.0:1789185535.624455:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:8162:x1876096812329472:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789185535.625204:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:8162:x1876096812329472:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 747us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185535.625215:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:2.0:1789185535.641456:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185535.641558:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812329600 00000100:00100000:3.0:1789185535.641570:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812329600 00000100:00100000:3.0:1789185535.641631:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 220 00000100:00100000:3.0:1789185535.641642:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:8162:x1876096812329600:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789185535.641904:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:8162:x1876096812329600:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 262us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185535.641922:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 220 00000100:00100000:3.0:1789185535.666695:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185535.666741:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185535.666841:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812329728 00000100:00100000:0.0:1789185535.666852:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812329728 00000100:00100000:0.0:1789185535.666903:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812329984 00000100:00100000:0.0:1789185535.666906:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812329984 00000100:00100000:0.0:1789185535.666937:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:0.0:1789185535.666947:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812329984:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185535.667036:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812329984:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 90us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185535.667045:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:0.0:1789185535.667063:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:0.0:1789185535.667068:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2368:x1876096812329728:12345-192.168.202.54@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789185535.667092:0:5823:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 8c8f5f6e-29cb-49a9-885e-2459dbca0795@192.168.202.54@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:0.0:1789185535.667120:0:5823:0:(genops.c:1384:class_connect()) connect: client 8c8f5f6e-29cb-49a9-885e-2459dbca0795, cookie 0x532743011272ba31 00000004:00100000:0.0:1789185535.667145:0:5823:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1789185535.667337:0:5823:0:(import.c:65:import_set_state_nolock()) ffff9c792fb0b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185535.667951:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+6:2368:x1876096812329728:12345-192.168.202.54@tcp:38:mount.lustre.0 Request processed in 878us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185535.667961:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789185535.675686:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185535.675936:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812329856 00000100:00100000:2.0:1789185535.675947:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812329856 00000100:00100000:2.0:1789185535.676032:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:2.0:1789185535.676040:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+6:0:x1876096812329856:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789185535.676085:0:5824:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789185535.676305:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+6:0:x1876096812329856:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 265us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185535.676313:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:3.0:1789185535.676519:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185535.677290:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812330112 00000100:00100000:0.0:1789185535.677297:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812330112 00000100:00100000:0.0:1789185535.677332:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:0.0:1789185535.677339:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+6:8154:x1876096812330112:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789185535.677376:0:5822:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1789185535.677425:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185535.677468:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+6:8154:x1876096812330112:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 128us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185535.677476:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:3.0:1789185535.690208:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185535.690626:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812330240 00000100:00100000:1.0:1789185535.690636:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812330240 00000100:00100000:1.0:1789185535.690697:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1789185535.690708:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+6:8154:x1876096812330240:12345-192.168.202.54@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789185535.690804:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+6:8154:x1876096812330240:12345-192.168.202.54@tcp:40:mount.lustre.0 Request processed in 97us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185535.690812:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1789185535.698501:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185535.698541:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185535.698573:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185535.698678:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812330368 00000100:00100000:0.0:1789185535.698687:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812330368 00000100:00100000:0.0:1789185535.698730:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812330496 00000100:00100000:0.0:1789185535.698733:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812330496 00000100:00100000:0.0:1789185535.698754:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:0.0:1789185535.698761:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2368:x1876096812330368:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789185535.698792:0:6678:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 8c8f5f6e-29cb-49a9-885e-2459dbca0795@192.168.202.54@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:0.0:1789185535.698829:0:6678:0:(genops.c:1384:class_connect()) connect: client 8c8f5f6e-29cb-49a9-885e-2459dbca0795, cookie 0x532743011272ba38 00002000:00100000:0.0:1789185535.698839:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8c8f5f6e-29cb-49a9-885e-2459dbca0795/ffff9c792fb0f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1789185535.698943:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1789185535.698948:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2368:x1876096812330496:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789185535.698964:0:6884:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 8c8f5f6e-29cb-49a9-885e-2459dbca0795@192.168.202.54@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1789185535.698986:0:6884:0:(genops.c:1384:class_connect()) connect: client 8c8f5f6e-29cb-49a9-885e-2459dbca0795, cookie 0x532743011272ba3f 00002000:00100000:1.0:1789185535.698991:0:6884:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8c8f5f6e-29cb-49a9-885e-2459dbca0795/ffff9c7936929800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789185535.699026:0:6884:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789185535.699260:0:6884:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789185535.699290:0:6884:0:(import.c:65:import_set_state_nolock()) ffff9c793692b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185535.699365:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+6:2368:x1876096812330496:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 401us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185535.699373:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00002000:00100000:0.0:1789185535.699750:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789185535.699973:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789185535.699993:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9c792fb09000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185535.700027:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+6:2368:x1876096812330368:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 1266us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185535.700035:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:3.0:1789185535.700242:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812330624 00000100:00100000:3.0:1789185535.700249:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812330624 00000100:00100000:3.0:1789185535.700291:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:3.0:1789185535.700299:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+6:8154:x1876096812330624:12345-192.168.202.54@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789185535.700382:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789185535.700457:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+6:8154:x1876096812330624:12345-192.168.202.54@tcp:33:mount.lustre.0 Request processed in 158us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185535.700464:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00010000:00010000:1.0:1789185536.143569:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789185536.560694:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8c8f5f6e-29cb-49a9-885e-2459dbca0795 00000100:00100000:1.0:1789185536.921129:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821799808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185536.921200:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185536.921571:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821799808 00000100:00100000:3.0:1789185536.921580:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821799808 00000100:00100000:3.0:1789185536.921639:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789185536.921649:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821799808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185536.921671:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185536.921719:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821799808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185536.921726:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789185536.921776:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789185536.921804:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c780247d500 x1876096821799808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185536.921820:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821799808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185536.922290:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821800320:0@lo:400:kworker.0 00000100:00100000:1.0:1789185536.922322:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185536.922357:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789185536.922363:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821800192:0@lo:400:kworker.0 00000100:00100000:1.0:1789185536.922427:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185536.922455:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821800320 00000100:00100000:1.0:1789185536.922460:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821800320 00000100:00100000:1.0:1789185536.922497:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789185536.922504:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821800320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185536.922541:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821800320:12345-0@lo:400:kworker.0 Request processed in 38us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185536.922563:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789185536.922588:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821800192 00000100:00100000:1.0:1789185536.922591:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821800192 00000100:00100000:1.0:1789185536.922616:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789185536.922622:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821800192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185536.922651:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821800192:12345-0@lo:400:kworker.0 Request processed in 29us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185536.922657:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1789185536.922678:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185536.922680:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185536.922697:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821800192:0@lo:400:kworker.0 00010000:00080000:1.0:1789185536.922707:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907c14380 x1876096821800320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185536.922717:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821800320:0@lo:400:kworker.0 00000100:00100000:0.0:1789185536.923133:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821799936:0@lo:400:kworker.0 00000100:00100000:0.0:1789185536.923167:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185536.923201:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821800448:0@lo:400:kworker.0 00000100:00100000:0.0:1789185536.923232:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185536.923249:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185536.923254:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821800064:0@lo:400:kworker.0 00000100:00100000:0.0:1789185536.923281:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185536.923305:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821800448 00000100:00100000:0.0:1789185536.923310:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821800448 00000100:00100000:0.0:1789185536.923724:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821800064 00000100:00100000:0.0:1789185536.923729:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821800064 00000100:00100000:0.0:1789185536.923771:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789185536.923778:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821800448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185536.923862:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821800448:12345-0@lo:400:kworker.0 Request processed in 84us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185536.923869:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789185536.923896:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789185536.923903:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821800064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185536.923930:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821800064:12345-0@lo:400:kworker.0 Request processed in 28us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185536.923936:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1789185536.923959:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185536.924560:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821800064:0@lo:400:kworker.0 00000100:00100000:0.0:1789185536.924571:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821800448:0@lo:400:kworker.0 00000100:00100000:1.0:1789185536.927064:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821799936 00000100:00100000:1.0:1789185536.927089:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821799936 00000100:00100000:1.0:1789185536.927153:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789185536.927163:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821799936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185536.927793:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821799936:12345-0@lo:400:kworker.0 Request processed in 629us (4622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185536.927801:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789185536.927899:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821799936:0@lo:400:kworker.0 00010000:00010000:1.0:1789185537.167699:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185537.940108:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821800576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185537.940181:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185537.941422:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821800576 00000100:00100000:1.0:1789185537.941435:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821800576 00000100:00100000:1.0:1789185537.941496:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789185537.941505:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821800576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789185537.941547:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185537.941608:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821800576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185537.941615:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789185537.941786:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907d03480 x1876096821800576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185537.941807:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821800576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789185538.191617:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789185539.070454:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8c8f5f6e-29cb-49a9-885e-2459dbca0795 00000001:00100000:1.0:1789185539.072940:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8c8f5f6e-29cb-49a9-885e-2459dbca0795 00010000:00010000:1.0:1789185539.215616:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185540.242790:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185540.743066:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185540.743283:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185540.743385:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185540.743387:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812331136 00000100:00100000:0.0:1789185540.743387:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812330880 00000100:00100000:1.0:1789185540.743401:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812331136 00000100:00100000:0.0:1789185540.743441:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812330880 00000100:00100000:3.0:1789185540.743469:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185540.743536:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185540.743562:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812330752 00000100:00100000:2.0:1789185540.743569:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812330752 00000100:00100000:0.0:1789185540.751667:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812331008 00000100:00100000:0.0:1789185540.751690:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812331008 00000100:00100000:0.0:1789185540.751762:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:0.0:1789185540.751774:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2369:x1876096812330880:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185540.751958:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2369:x1876096812330880:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 184us (8904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185540.751986:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:0.0:1789185540.752009:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:0.0:1789185540.752015:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812331008:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185540.752044:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812331008:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 30us (8578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185540.752050:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00080000:0.0:1789185540.752081:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185540.752088:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185540.753200:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812331264 00000100:00100000:0.0:1789185540.753211:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812331264 00000100:00100000:0.0:1789185540.754462:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:0.0:1789185540.754482:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812331136:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185540.754580:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812331136:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 106us (11307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185540.754588:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:0.0:1789185540.754611:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:0.0:1789185540.754619:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812331264:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185540.754645:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812331264:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 29us (11110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185540.754651:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00080000:0.0:1789185540.754677:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185540.760313:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 222 00000100:00100000:2.0:1789185540.760349:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2369:x1876096812330752:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185540.760498:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2369:x1876096812330752:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 167us (17113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185540.760507:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 222 00010000:00010000:1.0:1789185541.263775:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185542.033131:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821800832:0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.033222:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185542.033309:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821801344:0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.033373:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185542.033429:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789185542.033436:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821800704:0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.033467:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185542.033489:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1876096821801216:0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.033513:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185542.033541:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821800960:0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.033564:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185542.033585:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185542.033589:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821801088:0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.033612:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185542.033646:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821800832 00000100:00100000:1.0:1789185542.033656:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821800832 00000100:00100000:1.0:1789185542.033713:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821801216 00000100:00100000:1.0:1789185542.033717:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821801216 00000100:00100000:1.0:1789185542.033741:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821800960 00000100:00100000:1.0:1789185542.033744:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821800960 00000100:00100000:1.0:1789185542.033762:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789185542.033771:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821800832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.033833:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821800832:12345-0@lo:400:kworker.0 Request processed in 62us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185542.033840:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789185542.033862:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789185542.033869:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876096821801216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.033896:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876096821801216:12345-0@lo:400:kworker.0 Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185542.033902:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789185542.033913:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789185542.033919:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790833a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821800960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.033949:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790833a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821800960:12345-0@lo:400:kworker.0 Request processed in 30us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185542.033955:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789185542.033976:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821801344 00000100:00100000:1.0:1789185542.033980:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821801344 00000100:00100000:1.0:1789185542.034011:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821801088 00000100:00100000:1.0:1789185542.034014:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821801088 00000100:00100000:1.0:1789185542.034034:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789185542.034041:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790833bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821801344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.034075:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790833bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821801344:12345-0@lo:400:kworker.0 Request processed in 34us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185542.034090:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789185542.034101:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789185542.034107:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790833ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821801088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.034135:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790833ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821801088:12345-0@lo:400:kworker.0 Request processed in 28us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185542.034141:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789185542.034161:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821800704 00000100:00100000:1.0:1789185542.034164:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821800704 00000100:00100000:1.0:1789185542.034192:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789185542.034199:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3279:x1876096821800704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.034230:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3279:x1876096821800704:12345-0@lo:400:kworker.0 Request processed in 32us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185542.034236:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:1.0:1789185542.034275:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185542.034280:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185542.034283:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789185542.034336:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7907c14000 x1876096821801088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185542.034352:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821801088:0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.034364:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821800960:0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.034393:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821800704:0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.034403:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1876096821801216:0@lo:400:kworker.0 00000100:00100000:1.0:1789185542.034438:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821800832:0@lo:400:kworker.0 00010000:00080000:1.0:1789185542.034459:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f17dc00 x1876096821801344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185542.034468:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821801344:0@lo:400:kworker.0 00000100:00100000:2.0:1789185542.035169:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185542.035185:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821801472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185542.035234:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185542.035446:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821801472 00000100:00100000:3.0:1789185542.035453:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821801472 00000100:00100000:3.0:1789185542.035492:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789185542.035500:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821801472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185542.035537:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185542.035582:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821801472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185542.035588:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789185542.035634:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906b30a80 x1876096821801472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185542.035651:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821801472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789185542.296671:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789185542.599612:0:10307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1789185543.056395:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821801600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185543.056523:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185543.056762:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821801600 00000100:00100000:2.0:1789185543.056772:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821801600 00000100:00100000:2.0:1789185543.056970:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789185543.056984:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821801600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185543.057054:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185543.057119:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821801600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185543.057129:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1789185543.057178:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793ff94700 x1876096821801600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185543.057201:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821801600:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789185543.311632:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185544.335660:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185545.359621:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185545.865865:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185545.865908:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185545.865937:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185545.865973:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185545.865995:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185545.866083:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812331392 00000100:00100000:1.0:1789185545.866095:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812331392 00000100:00100000:1.0:1789185545.866160:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:1.0:1789185545.866171:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2372:x1876096812331392:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185545.866279:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2372:x1876096812331392:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 108us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185545.866287:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:1.0:1789185545.866325:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812331904 00000100:00100000:1.0:1789185545.866329:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812331904 00000100:00100000:3.0:1789185545.866363:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812331648 00000100:00100000:3.0:1789185545.866370:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812331648 00000100:00100000:1.0:1789185545.866370:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812331776 00000100:00100000:1.0:1789185545.866387:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812331776 00000100:00100000:3.0:1789185545.866430:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812331520 00000100:00100000:3.0:1789185545.866434:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812331520 00000100:00100000:1.0:1789185545.866453:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:3.0:1789185545.866462:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:1.0:1789185545.866467:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2372:x1876096812331904:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185545.866476:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2372:x1876096812331648:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185545.866502:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2372:x1876096812331904:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 40us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185545.866510:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:3.0:1789185545.866522:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2372:x1876096812331648:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 47us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185545.866529:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:3.0:1789185545.866534:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:1.0:1789185545.866541:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2372:x1876096812331776:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185545.866554:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:1.0:1789185545.866572:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2372:x1876096812331776:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 34us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.866579:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812331520:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185545.866593:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:3.0:1789185545.866613:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812331520:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 37us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.866621:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00080000:1.0:1789185545.866756:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185545.866762:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185545.866764:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789185546.383745:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185547.153342:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821801728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185547.153441:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185547.153472:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821801728 00000100:00100000:3.0:1789185547.153481:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821801728 00000100:00100000:3.0:1789185547.153557:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789185547.153568:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821801728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185547.153601:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185547.153647:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821801728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185547.153654:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789185547.153686:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789185547.153712:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906b31f80 x1876096821801728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185547.153730:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821801728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185547.159478:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821801984:0@lo:400:kworker.0 00000100:00100000:0.0:1789185547.159577:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185547.159627:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185547.159637:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f12bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821802112:0@lo:400:kworker.0 00000100:00100000:0.0:1789185547.159660:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185547.159694:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821801984 00000100:00100000:0.0:1789185547.159701:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821801984 00000100:00100000:0.0:1789185547.159749:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821802112 00000100:00100000:0.0:1789185547.159752:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821802112 00000100:00100000:0.0:1789185547.159786:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789185547.159797:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821801984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185547.159856:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821801984:12345-0@lo:400:kworker.0 Request processed in 60us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185547.159865:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789185547.159887:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789185547.159893:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821802112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185547.159916:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821802112:12345-0@lo:400:kworker.0 Request processed in 24us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185547.159922:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1789185547.159941:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185547.160204:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f12bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821802112:0@lo:400:kworker.0 00000100:00100000:0.0:1789185547.160216:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821801984:0@lo:400:kworker.0 00000100:00100000:0.0:1789185547.160240:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821802240:0@lo:400:kworker.0 00000100:00100000:0.0:1789185547.160278:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185547.160302:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789185547.160308:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821801856:0@lo:400:kworker.0 00000100:00100000:0.0:1789185547.160329:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185547.160432:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821802240 00000100:00100000:1.0:1789185547.160441:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821802240 00000100:00100000:1.0:1789185547.160487:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789185547.160494:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821802240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185547.160528:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821802240:12345-0@lo:400:kworker.0 Request processed in 34us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185547.160534:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789185547.161302:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821801856 00000100:00100000:1.0:1789185547.161310:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821801856 00000100:00100000:1.0:1789185547.161340:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789185547.161347:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821801856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185547.161384:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821801856:12345-0@lo:400:kworker.0 Request processed in 38us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185547.161390:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789185547.165643:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821801856:0@lo:400:kworker.0 00000100:00100000:0.0:1789185547.165661:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f12a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821802368:0@lo:400:kworker.0 00000100:00080000:1.0:1789185547.165676:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185547.165724:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789185547.165774:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f128700 x1876096821802240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185547.165785:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821802368 00000100:00100000:0.0:1789185547.165787:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821802240:0@lo:400:kworker.0 00000100:00100000:1.0:1789185547.165794:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821802368 00000100:00100000:1.0:1789185547.165867:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789185547.165889:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821802368:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789185547.165978:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185547.166096:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821802368:12345-0@lo:400:kworker.0 Request processed in 219us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185547.166104:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789185547.166175:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f12a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821802368:0@lo:400:kworker.0 00010000:00010000:1.0:1789185547.409579:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185548.177996:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821802496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185548.178077:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185548.178442:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821802496 00000100:00100000:2.0:1789185548.178452:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821802496 00000100:00100000:2.0:1789185548.178508:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789185548.178518:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821802496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185548.178553:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185548.178662:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821802496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185548.178670:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789185548.180457:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbd880 x1876096821802496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185548.180483:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821802496:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789185548.432984:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185549.455688:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185550.482580:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185550.985058:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185550.985112:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185550.985180:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812332160 00000100:00100000:2.0:1789185550.985207:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812332160 00000100:00100000:2.0:1789185550.985294:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:2.0:1789185550.985305:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2369:x1876096812332160:12345-192.168.202.54@tcp:400:kworker.0 00000100:00080000:0.0:1789185550.985346:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185550.985371:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812332032 00000100:00100000:1.0:1789185550.985376:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812332032 00000100:00100000:1.0:1789185550.985428:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00100000:1.0:1789185550.985435:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2369:x1876096812332032:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185550.985497:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2369:x1876096812332032:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 62us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185550.985504:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00100000:2.0:1789185550.985608:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2369:x1876096812332160:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 304us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185550.985616:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:1.0:1789185551.000032:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185551.000076:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185551.000099:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185551.000134:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812332416 00000100:00100000:1.0:1789185551.000143:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812332416 00000100:00100000:1.0:1789185551.000194:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812332544 00000100:00100000:1.0:1789185551.000197:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812332544 00000100:00100000:1.0:1789185551.000238:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:1.0:1789185551.000249:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790833b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812332416:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185551.000254:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:3.0:1789185551.000263:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812332544:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185551.000318:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812332544:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 54us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185551.000324:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:0.0:1789185551.000443:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812332288 00000100:00100000:0.0:1789185551.000447:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812332288 00000100:00100000:0.0:1789185551.000485:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:0.0:1789185551.000493:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812332288:12345-192.168.202.54@tcp:400:kworker.0 00000100:00080000:3.0:1789185551.001465:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185551.001471:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789185551.001474:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185551.002257:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790833b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812332416:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 2005us (2231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185551.002269:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:0.0:1789185551.002384:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812332288:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 1890us (2305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185551.002393:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 79 00010000:00010000:3.0:1789185551.506386:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185552.271749:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821802880:0@lo:400:kworker.0 00000100:00100000:0.0:1789185552.271768:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821802624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185552.271884:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821803008:0@lo:400:kworker.0 00000100:00100000:2.0:1789185552.275456:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821802752:0@lo:400:kworker.0 00000100:00100000:0.0:1789185552.276155:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185552.276229:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821802624 00000100:00100000:0.0:1789185552.276237:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821802624 00000100:00100000:0.0:1789185552.276304:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789185552.276314:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821802624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185552.276352:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789185552.276401:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821802624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185552.276502:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1789185552.276571:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906b31f80 x1876096821802624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185552.276594:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821802624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185552.276619:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821803264:0@lo:400:kworker.0 00000100:00100000:0.0:1789185552.277935:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185552.278003:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821803264 00000100:00100000:0.0:1789185552.278011:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821803264 00000100:00100000:0.0:1789185552.278072:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789185552.278082:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821803264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185552.278141:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821803264:12345-0@lo:400:kworker.0 Request processed in 61us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185552.278148:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789185552.278190:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821803264:0@lo:400:kworker.0 00000100:00100000:0.0:1789185552.278220:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185552.278229:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821803392:0@lo:400:kworker.0 00000100:00100000:0.0:1789185552.278276:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185552.278300:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821803392 00000100:00100000:0.0:1789185552.278303:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821803392 00000100:00100000:0.0:1789185552.278327:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789185552.278332:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821803392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185552.278361:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821803392:12345-0@lo:400:kworker.0 Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185552.278367:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1789185552.278394:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f25f100 x1876096821803392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185552.278424:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821803392:0@lo:400:kworker.0 00000100:00080000:0.0:1789185552.280157:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185552.280166:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185552.284838:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185552.284915:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821802880 00000100:00100000:0.0:1789185552.284927:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821802880 00000100:00100000:0.0:1789185552.284993:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789185552.285003:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821802880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185552.285082:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821802880:12345-0@lo:400:kworker.0 Request processed in 81us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185552.285090:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789185552.286551:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185552.286762:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821803008 00000100:00100000:0.0:1789185552.286770:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821803008 00000100:00100000:0.0:1789185552.286823:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789185552.286832:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821803008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185552.286890:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821803008:12345-0@lo:400:kworker.0 Request processed in 60us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185552.286897:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1789185552.286943:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185552.287262:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821802880:0@lo:400:kworker.0 00000100:00100000:1.0:1789185552.287389:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821803008:0@lo:400:kworker.0 00000100:00100000:2.0:1789185552.288091:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185552.288147:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821803136:0@lo:400:kworker.0 00000100:00100000:2.0:1789185552.288185:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185552.288816:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821803136 00000100:00100000:3.0:1789185552.288826:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821803136 00000100:00100000:3.0:1789185552.289042:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789185552.289055:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821803136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185552.289115:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821803136:12345-0@lo:400:kworker.0 Request processed in 64us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185552.289122:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1789185552.289218:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f25d880 x1876096821803136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185552.289244:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821803136:0@lo:400:kworker.0 00000100:00080000:0.0:1789185552.289662:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185552.290048:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821802752 00000100:00100000:1.0:1789185552.290055:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821802752 00000100:00100000:1.0:1789185552.290104:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789185552.290112:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821802752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185552.290191:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821802752:12345-0@lo:400:kworker.0 Request processed in 80us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185552.290208:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789185552.290259:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821802752:0@lo:400:kworker.0 00010000:00010000:3.0:1789185552.527744:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185553.305908:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821803520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185553.305978:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185553.306051:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821803520 00000100:00100000:3.0:1789185553.306059:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821803520 00000100:00100000:3.0:1789185553.306107:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789185553.306116:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821803520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185553.306149:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185553.306206:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821803520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185553.306214:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789185553.306268:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906b30380 x1876096821803520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185553.306287:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821803520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789185553.555685:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185554.576039:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185555.601831:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185556.110684:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185556.110881:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185556.110921:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185556.110943:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185556.110966:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185556.110990:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812332928 00000100:00100000:1.0:1789185556.111000:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812332928 00000100:00100000:1.0:1789185556.111063:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812332800 00000100:00100000:1.0:1789185556.111066:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812332800 00000100:00100000:1.0:1789185556.111085:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:1.0:1789185556.111538:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812332928:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185556.111611:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812332928:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 80us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185556.111619:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:1.0:1789185556.111640:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:1.0:1789185556.111647:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812332800:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185556.111668:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812332800:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 22us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185556.111674:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:1.0:1789185556.111693:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812333056 00000100:00100000:1.0:1789185556.111697:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812333056 00000100:00100000:1.0:1789185556.111728:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812333184 00000100:00100000:1.0:1789185556.111731:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812333184 00000100:00100000:1.0:1789185556.111759:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:1.0:1789185556.111765:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2368:x1876096812333056:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:1.0:1789185556.111785:0:6884:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272ba38 00000100:00080000:1.0:1789185556.111795:0:6884:0:(import.c:65:import_set_state_nolock()) ffff9c792fb09000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789185556.112327:0:6884:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789185556.112688:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+2:2368:x1876096812333056:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 919us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185556.112698:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:1.0:1789185556.112717:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:1.0:1789185556.112725:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7940efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2368:x1876096812333184:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:1.0:1789185556.112741:0:6884:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272ba3f 00000100:00080000:1.0:1789185556.112749:0:6884:0:(import.c:65:import_set_state_nolock()) ffff9c793692b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789185556.112778:0:6884:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789185556.113431:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7940efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+2:2368:x1876096812333184:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 682us (2438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185556.113440:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00080000:1.0:1789185556.113621:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185556.113626:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185556.113629:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789185556.115864:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185556.115874:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185556.116283:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812332672 00000100:00100000:0.0:1789185556.116293:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812332672 00000100:00100000:0.0:1789185556.116350:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:0.0:1789185556.116362:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812332672:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185556.116460:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812332672:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 100us (5785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185556.116468:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 228 00010000:00010000:1.0:1789185556.623528:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789185557.001004:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8c8f5f6e-29cb-49a9-885e-2459dbca0795 00000020:00000080:2.0:1789185557.001012:0:6703:0:(genops.c:885:class_export_put()) final put ffff9c792fb0f000/8c8f5f6e-29cb-49a9-885e-2459dbca0795 00000020:00000080:1.0:1789185557.001039:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c792fb0f000/8c8f5f6e-29cb-49a9-885e-2459dbca0795 for lustre-OST0000 00000020:00000080:1.0:1789185557.001098:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c792fb09000 for lustre-OST0000 00000100:00100000:3.0:1789185557.393039:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185557.393063:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821803648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185557.393134:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185557.394974:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821803648 00000100:00100000:0.0:1789185557.394986:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821803648 00000100:00100000:0.0:1789185557.395056:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789185557.395066:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821803648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185557.395104:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789185557.395212:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821803648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185557.395219:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1789185557.395245:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789185557.395281:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906b30380 x1876096821803648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185557.395302:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821803648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185557.399941:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821803776:0@lo:400:kworker.0 00000100:00100000:0.0:1789185557.400018:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185557.400062:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f1a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821804288:0@lo:400:kworker.0 00000100:00100000:0.0:1789185557.400088:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185557.400115:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185557.400129:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821803904:0@lo:400:kworker.0 00000100:00100000:0.0:1789185557.400182:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185557.400226:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821803776 00000100:00100000:0.0:1789185557.400234:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821803776 00000100:00100000:0.0:1789185557.400282:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789185557.400290:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821803776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185557.400340:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821803776:12345-0@lo:400:kworker.0 Request processed in 50us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185557.400346:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789185557.400378:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821804288 00000100:00100000:0.0:1789185557.400382:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821804288 00000100:00100000:0.0:1789185557.400455:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821803904 00000100:00100000:0.0:1789185557.400458:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821803904 00000100:00100000:0.0:1789185557.400473:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789185557.400478:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821804288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185557.400510:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821804288:12345-0@lo:400:kworker.0 Request processed in 31us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185557.400516:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789185557.400526:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789185557.400531:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821803904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185557.400556:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821803904:12345-0@lo:400:kworker.0 Request processed in 25us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185557.400562:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1789185557.400586:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185557.400597:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821804160:0@lo:400:kworker.0 00000100:00100000:0.0:1789185557.400624:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185557.400645:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185557.400659:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821804032:0@lo:400:kworker.0 00000100:00100000:0.0:1789185557.400682:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185557.400707:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821804160 00000100:00100000:0.0:1789185557.400711:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821804160 00000100:00100000:0.0:1789185557.400743:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789185557.400749:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821804160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185557.400783:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821804160:12345-0@lo:400:kworker.0 Request processed in 34us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185557.400790:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1789185557.400888:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789185557.400918:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f1abb80 x1876096821804160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185557.400932:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821804160:0@lo:400:kworker.0 00000100:00100000:0.0:1789185557.400952:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821804032 00000100:00100000:0.0:1789185557.400955:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821804032 00000100:00100000:0.0:1789185557.400981:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789185557.400987:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821804032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185557.401018:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821804032:12345-0@lo:400:kworker.0 Request processed in 32us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185557.401024:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1789185557.401038:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185557.401055:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821804032:0@lo:400:kworker.0 00000100:00100000:0.0:1789185557.401085:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821803904:0@lo:400:kworker.0 00000100:00100000:0.0:1789185557.401093:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821803776:0@lo:400:kworker.0 00000100:00100000:0.0:1789185557.401102:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f1a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821804288:0@lo:400:kworker.0 00010000:00010000:1.0:1789185557.647632:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185558.416198:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821804416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185558.416279:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185558.416436:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821804416 00000100:00100000:3.0:1789185558.416445:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821804416 00000100:00100000:3.0:1789185558.416497:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789185558.416508:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821804416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185558.416545:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185558.416605:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821804416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185558.416614:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1789185558.416802:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906b33480 x1876096821804416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185558.416823:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821804416:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789185558.672243:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789185559.505365:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8c8f5f6e-29cb-49a9-885e-2459dbca0795 00000020:00000080:0.0:1789185559.505376:0:7633:0:(genops.c:885:class_export_put()) final put ffff9c7936929800/8c8f5f6e-29cb-49a9-885e-2459dbca0795 00000020:00000080:1.0:1789185559.505473:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7936929800/8c8f5f6e-29cb-49a9-885e-2459dbca0795 for lustre-OST0001 00000020:00000080:1.0:1789185559.505524:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c793692b800 for lustre-OST0001 00010000:00010000:2.0:1789185559.702204:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185560.721719:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185561.224814:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185561.224867:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185561.224904:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185561.225073:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812333312 00000100:00100000:2.0:1789185561.225084:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812333312 00000100:00100000:2.0:1789185561.225152:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 230 00000100:00100000:2.0:1789185561.225163:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2369:x1876096812333312:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185561.225230:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2369:x1876096812333312:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 68us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.225237:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 230 00000100:00100000:0.0:1789185561.225346:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812333568 00000100:00100000:0.0:1789185561.225351:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812333568 00000100:00100000:0.0:1789185561.225446:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812333440 00000100:00100000:0.0:1789185561.225450:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812333440 00000100:00100000:0.0:1789185561.225468:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:0.0:1789185561.225475:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790833bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812333568:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185561.225509:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790833bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812333568:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 35us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.225515:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:0.0:1789185561.225527:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00100000:0.0:1789185561.225533:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790833ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2369:x1876096812333440:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185561.225554:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790833ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2369:x1876096812333440:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 22us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.225560:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00080000:2.0:1789185561.225754:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789185561.744204:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789185562.129579:0:11012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789185562.512708:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c790833b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821804800:0@lo:400:kworker.0 00000100:00100000:3.0:1789185562.512757:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7908339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821804928:0@lo:400:kworker.0 00000100:00100000:2.0:1789185562.512791:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185562.512796:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c790833a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821805056:0@lo:400:kworker.0 00000100:00100000:0.0:1789185562.512849:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7908339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821804672:0@lo:400:kworker.0 00000100:00100000:1.0:1789185562.512917:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821804800 00000100:00100000:1.0:1789185562.512926:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821804800 00000100:00100000:1.0:1789185562.512979:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789185562.512988:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821804800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185562.519152:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185562.519274:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185562.519311:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789185562.519333:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789185562.519452:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821804928 00000100:00100000:3.0:1789185562.519462:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821804928 00000100:00100000:3.0:1789185562.519506:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789185562.519515:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789185562.519524:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821804928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185562.519553:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185562.519582:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821804544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185562.519583:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821804928:12345-0@lo:400:kworker.0 Request processed in 60us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185562.519609:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789185562.519629:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185562.519649:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7908339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821804928:0@lo:400:kworker.0 00000100:00100000:0.0:1789185562.519652:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c790833b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821805184:0@lo:400:kworker.0 00000100:00100000:0.0:1789185562.519681:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185562.519711:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789185562.519716:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821805184 00000100:00100000:0.0:1789185562.519720:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821805184 00000100:00100000:0.0:1789185562.519741:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789185562.519747:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789185562.519754:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821805184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185562.519787:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821805184:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185562.519793:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789185562.519810:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821804672 00000100:00100000:0.0:1789185562.519814:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821804672 00000100:00100000:0.0:1789185562.519837:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789185562.519844:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821804672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185562.519871:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821804672:12345-0@lo:400:kworker.0 Request processed in 28us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185562.519877:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789185562.519904:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821804544 00000100:00100000:0.0:1789185562.519908:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821804544 00000100:00100000:0.0:1789185562.519931:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789185562.519937:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821804544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185562.519964:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789185562.519994:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821804544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185562.520001:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789185562.520032:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7908339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821804672:0@lo:400:kworker.0 00010000:00080000:0.0:1789185562.520045:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906b33480 x1876096821804544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185578 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185562.520081:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821804544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185562.520096:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c790833b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821805184:0@lo:400:kworker.0 00000100:00080000:3.0:1789185562.520126:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789185562.520131:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185562.520455:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821805056 00000100:00100000:0.0:1789185562.520460:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821805056 00000100:00100000:0.0:1789185562.520495:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789185562.520502:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821805056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185562.520606:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821805056:12345-0@lo:400:kworker.0 Request processed in 104us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185562.520613:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789185562.520639:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c790833a300 x1876096821805056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789185562.520643:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185562.520650:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c790833a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821805056:0@lo:400:kworker.0 00000100:00100000:1.0:1789185562.521346:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821804800:12345-0@lo:400:kworker.0 Request processed in 8356us (8551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185562.521356:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789185562.521555:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c790833b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821804800:0@lo:400:kworker.0 00000100:00100000:2.0:1789185562.521565:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c790833b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821805312:0@lo:400:kworker.0 00000100:00100000:2.0:1789185562.521597:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185562.524143:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821805312 00000100:00100000:1.0:1789185562.524157:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821805312 00000100:00100000:1.0:1789185562.524223:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789185562.524232:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821805312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185562.524428:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821805312:12345-0@lo:400:kworker.0 Request processed in 197us (2829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185562.524436:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789185562.524528:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c790833b800 x1876096821805312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185562.524543:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c790833b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821805312:0@lo:400:kworker.0 00010000:00010000:2.0:1789185562.767777:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185563.535616:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821805440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185563.535689:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185563.535878:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821805440 00000100:00100000:3.0:1789185563.535886:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821805440 00000100:00100000:3.0:1789185563.535940:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789185563.535950:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790833aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821805440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185563.535985:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185563.536046:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790833aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821805440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185563.536054:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1789185563.536105:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906b31500 x1876096821805440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185563.536124:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821805440:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789185563.791956:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185564.822220:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185565.840187:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789185566.196216:0:11161:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8a437df0 20000000:00000080:2.0:1789185566.196233:0:11161:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c793fca8400 uarg=0000000000000000 20000000:01000000:2.0:1789185566.196267:0:11161:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789185566.196273:0:11161:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789185566.196277:0:11161:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789185566.197153:0:11162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789185566.197279:0:11161:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789185566.202060:0:11161:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789185566.202153:0:11161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7907354000/0x532743011272ba46 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.202175:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79234d6200/0x532743011272b9eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d402 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.202184:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c793fe05400/0x532743011272b9f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272b9f2 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.202191:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79234d7000/0x532743011272ba07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ba00 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.202216:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79234d6a00/0x532743011272ba15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ba0e expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.202223:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79234d6000/0x532743011272ba2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d43a expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.202230:0:11161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7907354000/0x532743011272ba46 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.202271:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79234d6000/0x532743011272ba2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d43a expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.202289:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c79234d6000/0x532743011272ba2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d43a expref: 12 pid: 5815 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185566.202303:0:11161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f1a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876096821805568:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185566.202638:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79234d6a00/0x532743011272ba15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272ba0e expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.202647:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c79234d6a00/0x532743011272ba15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272ba0e expref: 18 pid: 5815 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185566.202656:0:11161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f1abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876096821805696:0@lo:104: 00000100:00100000:0.0:1789185566.202694:0:11161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185566.202767:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821805696 00000100:00100000:1.0:1789185566.202775:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821805696 00000100:00100000:1.0:1789185566.202827:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789185566.202837:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:11161:x1876096821805696:12345-0@lo:104: 00010000:00010000:1.0:1789185566.202850:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c79234d7200/0x532743011272ba0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ba15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185566.209496:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185566.209525:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812333696 00000100:00100000:2.0:1789185566.209546:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812333696 00010000:00010000:2.0:1789185566.209583:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79234d6000/0x532743011272ba2a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d43a expref: 13 pid: 5815 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185566.209629:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:2.0:1789185566.209639:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791f904c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2371:x1876096812333696:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185566.209653:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185566.209659:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79234d6000/0x532743011272ba2a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d43a expref: 13 pid: 5815 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185566.209675:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79234d6000/0x532743011272ba2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d43a expref: 13 pid: 5815 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185566.209695:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185566.209750:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791f904c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2371:x1876096812333696:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 112us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185566.209758:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00010000:00010000:0.0:1789185566.210787:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79234d7000/0x532743011272ba07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272ba00 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.210803:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c79234d7000/0x532743011272ba07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272ba00 expref: 18 pid: 5816 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185566.210830:0:11161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f1aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876096821805824:0@lo:104: 00010000:00010000:1.0:1789185566.210858:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789185566.210871:0:11161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185566.210877:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:11161:x1876096821805696:12345-0@lo:104: Request processed in 8039us (8179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185566.210887:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1789185566.210899:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c793fe05400/0x532743011272b9f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272b9f2 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185566.210909:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821805824 00010000:00010000:0.0:1789185566.210910:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c793fe05400/0x532743011272b9f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272b9f2 expref: 18 pid: 5816 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185566.210916:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821805824 00000100:00100000:1.0:1789185566.210939:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789185566.210946:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f12b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:11161:x1876096821805824:12345-0@lo:104: 00010000:00010000:1.0:1789185566.210956:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c794216d800/0x532743011272ba00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ba07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185566.210996:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789185566.211002:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f12b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:11161:x1876096821805824:12345-0@lo:104: Request processed in 57us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185566.211007:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789185566.211248:0:11161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f129880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876096821805952:0@lo:104: 00000100:00100000:0.0:1789185566.211277:0:11161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185566.211307:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79234d6200/0x532743011272b9eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d402 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.211321:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c79234d6200/0x532743011272b9eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d402 expref: 12 pid: 5817 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185566.211331:0:11161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f129180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876096821806080:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789185566.211500:0:11161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c794125e0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789185566.211526:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d6000/0x532743011272ba2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d43a expref: 12 pid: 5815 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185566.211539:0:11161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f1a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876096821805568:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789185566.211549:0:11161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f1abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876096821805696:0@lo:104: 00000100:00100000:0.0:1789185566.211557:0:11161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f1aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876096821805824:0@lo:104: 00010000:00010000:2.0:1789185566.211973:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789185566.211982:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c79234d7200/0x532743011272ba0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ba15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185566.211999:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7200 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:2.0:1789185566.212003:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c79234d7200/0x532743011272ba0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272ba15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185566.212013:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79234d7200/0x532743011272ba0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272ba15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185566.212014:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1789185566.212020:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79234d7200/0x532743011272ba0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272ba15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185566.212026:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789185566.212055:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c79234d7200/0x532743011272ba0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ba15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185566.212062:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185566.212097:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c79234d7200/0x532743011272ba0e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ba15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185566.212105:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79234d7200/0x532743011272ba0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ba15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185566.212116:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185566.212118:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185566.212119:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185566.212579:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821805952 00000100:00100000:1.0:1789185566.212587:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821805952 00000100:00100000:1.0:1789185566.212752:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789185566.212763:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:11161:x1876096821805952:12345-0@lo:104: 00010000:00010000:1.0:1789185566.212774:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c79234d7a00/0x532743011272b9f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b9f9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185566.212837:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789185566.212843:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+3:11161:x1876096821805952:12345-0@lo:104: Request processed in 83us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185566.212849:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789185566.212867:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185566.212871:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c79234d7a00/0x532743011272b9f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272b9f9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185566.212890:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7a00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:1.0:1789185566.212894:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c79234d7a00/0x532743011272b9f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272b9f9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185566.212901:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79234d7a00/0x532743011272b9f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272b9f9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185566.212907:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79234d7a00/0x532743011272b9f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272b9f9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185566.212913:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789185566.212933:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c79234d7a00/0x532743011272b9f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b9f9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185566.212939:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789185566.212956:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c79234d7a00/0x532743011272b9f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b9f9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185566.212962:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79234d7a00/0x532743011272b9f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272b9f9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185566.212972:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185566.212974:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185566.212975:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185566.212987:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7908338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821806336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789185566.213019:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185566.213061:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821806336 00000100:00100000:1.0:1789185566.213065:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821806336 00010000:00010000:1.0:1789185566.213091:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c793fe05400/0x532743011272b9f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b9f2 expref: 19 pid: 5816 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185566.213119:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789185566.213125:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908338a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821806336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789185566.213135:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789185566.213137:0:11161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f129880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876096821805952:0@lo:104: 00010000:00010000:1.0:1789185566.213141:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c793fe05400/0x532743011272b9f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272b9f2 expref: 19 pid: 5816 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185566.213150:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c793fe05400/0x532743011272b9f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272b9f2 expref: 19 pid: 5816 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185566.213164:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c793fe05400/0x532743011272b9f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272b9f2 expref: 19 pid: 5816 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185566.213175:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185566.213207:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908338a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:3280:x1876096821806336:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185566.213213:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789185566.213242:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7908338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821806336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185566.214556:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185566.214575:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821806208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185566.214619:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185566.214664:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821806208 00000100:00100000:3.0:1789185566.214672:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821806208 00010000:00010000:3.0:1789185566.214701:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79234d6a00/0x532743011272ba15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ba0e expref: 18 pid: 5815 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185566.214739:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185566.214757:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:3278:x1876096821806208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185566.214769:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185566.214775:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79234d6a00/0x532743011272ba15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ba0e expref: 18 pid: 5815 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185566.214793:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79234d6a00/0x532743011272ba15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272ba0e expref: 18 pid: 5815 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185566.214809:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d6a00/0x532743011272ba15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272ba0e expref: 18 pid: 5815 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185566.214821:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185566.214857:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+17:3278:x1876096821806208:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185566.214863:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185566.214899:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821806208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185566.214960:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185566.214962:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185566.214964:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185566.215029:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c794216d800/0x532743011272ba00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ba07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215040:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c794216d800 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:0.0:1789185566.215045:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c794216d800/0x532743011272ba00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272ba07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215054:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c794216d800/0x532743011272ba00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272ba07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185566.215059:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c794216d800/0x532743011272ba00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272ba07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185566.215081:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789185566.215108:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c794216d800/0x532743011272ba00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ba07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215115:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185566.215136:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c794216d800/0x532743011272ba00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ba07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215141:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c794216d800/0x532743011272ba00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ba07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215153:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185566.215154:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185566.215155:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185566.215169:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f12a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821806464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185566.215175:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185566.215196:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185566.215223:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812333824 00000100:00100000:2.0:1789185566.215228:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812333824 00000100:00100000:0.0:1789185566.215247:0:11161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f129180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876096821806080:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789185566.215250:0:6692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79234d6200/0x532743011272b9eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d402 expref: 12 pid: 5817 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215271:0:11161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7907354000/0x532743011272ba46 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185566.215299:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821806464 00000100:00100000:2.0:1789185566.215303:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821806464 00010000:00010000:2.0:1789185566.215316:0:6692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79234d7000/0x532743011272ba07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ba00 expref: 17 pid: 5816 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185566.215339:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:2.0:1789185566.215346:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:2372:x1876096812333824:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185566.215355:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185566.215358:0:6692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79234d6200/0x532743011272b9eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d402 expref: 12 pid: 5817 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185566.215367:0:6692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79234d6200/0x532743011272b9eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d402 expref: 12 pid: 5817 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185566.215376:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1789185566.215380:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d6200/0x532743011272b9eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d402 expref: 12 pid: 5817 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185566.215386:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+17:3281:x1876096821806464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789185566.215393:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185566.215394:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185566.215400:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79234d7000/0x532743011272ba07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ba00 expref: 17 pid: 5816 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215427:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79234d7000/0x532743011272ba07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272ba00 expref: 17 pid: 5816 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215434:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d7000/0x532743011272ba07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272ba00 expref: 17 pid: 5816 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215444:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7907354000/0x532743011272ba46 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215451:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7907354000/0x532743011272ba46 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185566.215460:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:2372:x1876096812333824:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 113us (289us total) trans 0 rc 0/0 00010000:00010000:0.0:1789185566.215461:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7907354000/0x532743011272ba46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215474:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7907354000/0x532743011272ba46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185566.215475:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00010000:00010000:0.0:1789185566.215491:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7907354000/0x532743011272ba46 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215496:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7907354000/0x532743011272ba46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215499:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354000 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185566.215502:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7907354000/0x532743011272ba46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215507:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7907354000/0x532743011272ba46 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215516:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7907354000/0x532743011272ba46 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215524:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185566.215548:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+16:3281:x1876096821806464:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185566.215553:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789185566.215576:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f12a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821806464:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185566.215587:0:11161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7907354000/0x532743011272ba46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215592:0:11161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7907354000/0x532743011272ba46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185566.215596:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7907354000/0x532743011272ba46 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185566.352400:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185566.352449:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185566.359057:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812333952 00000100:00100000:0.0:1789185566.359084:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812333952 00000100:00100000:0.0:1789185566.359151:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812334080 00000100:00100000:0.0:1789185566.359155:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812334080 00000100:00100000:0.0:1789185566.359704:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:0.0:1789185566.359720:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812333952:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185566.359806:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812333952:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 91us (7412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185566.361468:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:1.0:1789185566.361487:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812334080:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185566.361560:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812334080:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 80us (9109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185566.361569:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:0.0:1789185566.361727:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00080000:0.0:1789185566.361751:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789185566.866398:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789185567.375739:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789185567.375750:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c793f2ba800 from 7 10000000:01000000:3.0:1789185567.375756:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185567.375826:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272ba4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185567.375840:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272ba4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185567.375871:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272ba4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185567.375906:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821806592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789185567.376541:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185567.376779:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906be59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185567.378983:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821806592 00000100:00100000:1.0:1789185567.379006:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821806592 00000100:00100000:1.0:1789185567.379107:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789185567.379121:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821806592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185567.379158:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185567.379184:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79013eda00/0x532743011272ba54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272ba4d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185567.379220:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79013eda00/0x532743011272ba54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272ba4d expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185567.379235:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79013eda00/0x532743011272ba54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ba4d expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185567.379244:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013eda00, rc 0) 00000100:00100000:1.0:1789185567.379346:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821806592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (2807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185567.379353:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789185567.391541:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821806592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185567.391698:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272ba4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ba54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185567.391716:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272ba4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272ba54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185567.391851:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821806720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185567.391924:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185567.391961:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906bef180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185567.392780:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821806720 00000100:00100000:0.0:1789185567.392797:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821806720 00000100:00100000:0.0:1789185567.392877:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789185567.392889:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821806720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185567.394722:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821806720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1828us (2790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185567.394739:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789185567.394915:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821806720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185567.395002:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821806848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185567.395179:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185567.395219:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906bef180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185567.395539:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821806848 00000100:00100000:0.0:1789185567.396009:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821806848 00000100:00100000:0.0:1789185567.397728:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789185567.397756:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821806848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185567.398073:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821806848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 319us (2881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185567.398083:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789185567.398230:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821806848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789185567.400115:0:11177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789185567.400249:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789185567.400274:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789185567.400289:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272ba4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ba54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185567.400303:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272ba4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ba54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185567.400320:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789185567.400324:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c791f9b0000 from 7 10000000:01000000:2.0:1789185567.400327:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789185567.400380:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d7600/0x532743011272ba5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185567.400390:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79234d7600/0x532743011272ba5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185567.400450:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79234d7600/0x532743011272ba5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185567.400482:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821806976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789185567.404706:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185567.414139:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906befd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789185567.418122:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821806976 00000100:00100000:1.0:1789185567.418147:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821806976 00000100:00100000:1.0:1789185567.418267:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789185567.418281:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821806976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185567.418305:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185567.418332:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79013ec800/0x532743011272ba62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272ba5b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185567.418374:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79013ec800/0x532743011272ba62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272ba5b expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185567.418387:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79013ec800/0x532743011272ba62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ba5b expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185567.418399:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013ec800, rc 0) 00000100:00100000:1.0:1789185567.418572:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821806976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 294us (18012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185567.418580:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789185567.420287:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821806976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185567.420326:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79234d7600/0x532743011272ba5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ba62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185567.420341:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79234d7600/0x532743011272ba5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272ba62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185567.420474:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821807104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185567.420665:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185567.420839:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906befd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789185567.422811:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821807104 00000100:00100000:1.0:1789185567.422830:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821807104 00000100:00100000:1.0:1789185567.422924:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789185567.422936:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821807104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185567.423372:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821807104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 438us (2706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185567.423382:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789185567.429774:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821807104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185567.429869:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821807232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185567.429967:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185567.430011:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906befd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789185567.430126:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821807232 00000100:00100000:1.0:1789185567.430135:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821807232 00000100:00100000:1.0:1789185567.430207:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789185567.430218:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821807232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185567.430502:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821807232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 284us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185567.430511:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789185567.430690:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821807232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789185567.432081:0:11178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789185567.432348:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789185567.432376:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789185567.432389:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d7600/0x532743011272ba5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ba62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185567.432435:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79234d7600/0x532743011272ba5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ba62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185567.432449:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789185567.432452:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c79102db000 from 7 10000000:01000000:1.0:1789185567.432455:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789185567.432521:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013ed000/0x532743011272ba69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185567.432530:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79013ed000/0x532743011272ba69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185567.432542:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79013ed000/0x532743011272ba69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185567.432582:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7908339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821807360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789185567.432657:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185567.432707:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7910fcba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185567.432820:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821807360 00000100:00100000:2.0:1789185567.432829:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821807360 00000100:00100000:2.0:1789185567.432894:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789185567.432905:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821807360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185567.432920:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185567.432936:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d6200/0x532743011272ba70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272ba69 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185567.432963:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d6200/0x532743011272ba70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272ba69 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185567.432977:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d6200/0x532743011272ba70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ba69 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185567.432987:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6200, rc 0) 00000100:00100000:2.0:1789185567.433040:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821807360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185567.433047:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789185567.435826:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7908339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821807360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185567.435883:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79013ed000/0x532743011272ba69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ba70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185567.435898:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79013ed000/0x532743011272ba69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272ba70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185567.435995:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f12a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821807488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185567.436073:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185567.436127:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c794125e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789185567.436260:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821807488 00000100:00100000:1.0:1789185567.436269:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821807488 00000100:00100000:1.0:1789185567.436325:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789185567.436337:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821807488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185567.436785:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821807488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 448us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185567.436794:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789185567.436911:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f12a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821807488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185567.436949:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f12a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821807616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185567.436993:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185567.437020:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c794125e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789185567.437116:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821807616 00000100:00100000:1.0:1789185567.437121:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821807616 00000100:00100000:1.0:1789185567.437143:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789185567.437151:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821807616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185567.437325:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821807616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185567.437331:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789185567.438828:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f12a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821807616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789185567.444502:0:11179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789185567.447686:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789185567.447734:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185567.447750:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013ed000/0x532743011272ba69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ba70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185567.447766:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79013ed000/0x532743011272ba69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ba70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185567.631925:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821808000:0@lo:400:kworker.0 00000100:00100000:2.0:1789185567.632021:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185567.632092:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821807872:0@lo:400:kworker.0 00000100:00100000:2.0:1789185567.632111:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185567.632117:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821808128:0@lo:400:kworker.0 00000100:00100000:0.0:1789185567.632130:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185567.632160:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789185567.632162:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821808000 00000100:00100000:0.0:1789185567.632165:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821807744:0@lo:400:kworker.0 00000100:00100000:2.0:1789185567.632170:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821808000 00000100:00100000:0.0:1789185567.632184:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185567.632201:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821808256:0@lo:400:kworker.0 00000100:00100000:0.0:1789185567.632220:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185567.632263:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821807872 00000100:00100000:0.0:1789185567.632285:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821807872 00000100:00100000:0.0:1789185567.632321:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821807744 00000100:00100000:0.0:1789185567.632324:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821807744 00000100:00100000:0.0:1789185567.632365:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789185567.632375:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821807872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185567.632387:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789185567.632396:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821807744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185567.632459:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821807744:12345-0@lo:400:kworker.0 Request processed in 64us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185567.632459:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821807872:12345-0@lo:400:kworker.0 Request processed in 84us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185567.632467:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789185567.632517:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185567.632525:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821808384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185567.632572:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185567.632604:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821808384 00000100:00100000:3.0:1789185567.632607:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821808384 00000100:00100000:2.0:1789185567.632760:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821808256 00000100:00100000:2.0:1789185567.632765:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821808256 00000100:00100000:2.0:1789185567.632789:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789185567.632796:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821808000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185567.632835:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821808000:12345-0@lo:400:kworker.0 Request processed in 40us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185567.632853:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789185567.632867:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789185567.632873:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1876096821808256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185567.632902:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1876096821808256:12345-0@lo:400:kworker.0 Request processed in 30us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185567.632907:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789185567.632923:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185567.632928:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789185567.632930:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185567.632950:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789185567.632986:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f25c380 x1876096821808000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185567.633002:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821808000:0@lo:400:kworker.0 00000100:00100000:2.0:1789185567.633026:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821808128 00000100:00100000:2.0:1789185567.633030:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821808128 00000100:00100000:3.0:1789185567.633183:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789185567.633191:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821808384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185567.633233:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185567.633272:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821808384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185567.633279:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789185567.633311:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906b31880 x1876096821808384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185567.633328:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821808384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185567.634595:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821807744:0@lo:400:kworker.0 00010000:00080000:1.0:1789185567.634632:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f25ed80 x1876096821808256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185567.634643:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821808256:0@lo:400:kworker.0 00000100:00100000:1.0:1789185567.634657:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821807872:0@lo:400:kworker.0 00000100:00100000:0.0:1789185567.637138:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789185567.638380:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789185567.638423:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821808128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185567.640955:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821808128:12345-0@lo:400:kworker.0 Request processed in 2550us (7991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185567.640974:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1789185567.642896:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185567.645481:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821808128:0@lo:400:kworker.0 00010000:00010000:0.0:1789185567.891251:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185568.011983:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185568.012594:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812334208 00000100:00100000:1.0:1789185568.012608:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812334208 00000100:00100000:1.0:1789185568.012703:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 241 00000100:00100000:1.0:1789185568.012716:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:5614:x1876096812334208:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185568.012736:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185568.012757:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79013ece00/0x532743011272ba77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d464 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185568.012793:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79013ece00/0x532743011272ba77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d464 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185568.012806:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79013ece00/0x532743011272ba77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d464 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185568.012818:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013ece00, rc 0) 00000100:00100000:1.0:1789185568.012898:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:5614:x1876096812334208:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 185us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185568.012906:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 241 00000100:00100000:2.0:1789185568.037488:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185568.037806:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812334336 00000100:00100000:1.0:1789185568.037821:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812334336 00000100:00100000:1.0:1789185568.037942:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 242 00000100:00100000:1.0:1789185568.037955:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:5614:x1876096812334336:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185568.038340:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:5614:x1876096812334336:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 386us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185568.038349:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 242 00000100:00100000:3.0:1789185568.054936:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185568.055095:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812334464 00000100:00100000:1.0:1789185568.055109:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812334464 00000100:00100000:1.0:1789185568.055185:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 243 00000100:00100000:1.0:1789185568.055198:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:5614:x1876096812334464:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185568.055572:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:5614:x1876096812334464:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 376us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185568.055581:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 243 00000100:00100000:1.0:1789185568.064387:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185568.064567:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812334592 00000100:00100000:0.0:1789185568.064581:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812334592 00000100:00100000:0.0:1789185568.064655:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 244 00000100:00100000:0.0:1789185568.064667:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:5614:x1876096812334592:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185568.064690:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185568.064714:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7907355000/0x532743011272ba7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d46b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185568.064749:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7907355000/0x532743011272ba7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d46b expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185568.064761:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7907355000/0x532743011272ba7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d46b expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185568.064773:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355000, rc 0) 00000100:00100000:0.0:1789185568.064845:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:5614:x1876096812334592:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 181us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185568.064853:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 244 00000100:00100000:2.0:1789185568.071608:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185568.071852:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812334720 00000100:00100000:3.0:1789185568.071866:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812334720 00000100:00100000:3.0:1789185568.071941:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 245 00000100:00100000:3.0:1789185568.071955:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:5614:x1876096812334720:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185568.073101:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:5614:x1876096812334720:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 1141us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185568.073117:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 245 00000100:00100000:0.0:1789185568.080682:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185568.089245:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812334848 00000100:00100000:1.0:1789185568.089267:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812334848 00000100:00100000:0.0:1789185568.089487:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 246 00000100:00100000:0.0:1789185568.089500:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:5614:x1876096812334848:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185568.089809:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:5614:x1876096812334848:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 310us (9139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185568.089817:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 246 00000100:00100000:1.0:1789185568.656507:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821808512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185568.656626:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185568.656773:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821808512 00000100:00100000:2.0:1789185568.656784:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821808512 00000100:00100000:2.0:1789185568.656848:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789185568.656868:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821808512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185568.656914:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185568.661437:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821808512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4556us (4797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185568.661458:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1789185568.663342:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906b31880 x1876096821808512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185568.663381:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821808512:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789185568.911885:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185569.935521:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185570.966372:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185571.466643:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185571.466704:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185571.466742:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185571.466782:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812335104 00000100:00100000:1.0:1789185571.466800:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812335104 00000100:00100000:1.0:1789185571.466857:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812335232 00000100:00100000:1.0:1789185571.466860:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812335232 00000100:00100000:1.0:1789185571.466889:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:1.0:1789185571.466900:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812335104:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185571.466975:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812335104:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 77us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185571.466982:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:1.0:1789185571.467003:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:1.0:1789185571.467010:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790833b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2372:x1876096812335232:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185571.467051:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790833b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2372:x1876096812335232:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 41us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185571.467057:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00080000:1.0:1789185571.467076:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185571.468535:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812334976 00000100:00100000:0.0:1789185571.468547:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812334976 00000100:00100000:0.0:1789185571.468602:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 247 00000100:00100000:0.0:1789185571.468612:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2372:x1876096812334976:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185571.468774:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2372:x1876096812334976:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 163us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185571.468782:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 247 00000001:02000400:3.0:1789185571.482149:0:11360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789185571.983687:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185572.751581:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185572.751613:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821808640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185572.751721:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185572.751782:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821808640 00000100:00100000:0.0:1789185572.751792:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821808640 00000100:00100000:0.0:1789185572.751895:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789185572.751908:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821808640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185572.751957:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789185572.752029:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821808640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185572.752037:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1789185572.752089:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906b33100 x1876096821808640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185588 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185572.752110:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821808640:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789185572.752510:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185572.759433:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821808768:0@lo:400:kworker.0 00000100:00100000:3.0:1789185572.759556:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185572.759605:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821809280:0@lo:400:kworker.0 00000100:00100000:3.0:1789185572.759659:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185572.759695:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185572.759702:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821808896:0@lo:400:kworker.0 00000100:00100000:3.0:1789185572.759724:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185572.759767:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821808768 00000100:00100000:3.0:1789185572.759776:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821808768 00000100:00100000:3.0:1789185572.759838:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789185572.759862:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821808768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185572.759936:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821808768:12345-0@lo:400:kworker.0 Request processed in 75us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185572.759944:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789185572.759986:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821809280 00000100:00100000:3.0:1789185572.759991:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821809280 00000100:00100000:3.0:1789185572.760047:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821808896 00000100:00100000:3.0:1789185572.760051:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821808896 00000100:00100000:3.0:1789185572.760070:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789185572.760076:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821809280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185572.760109:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821809280:12345-0@lo:400:kworker.0 Request processed in 33us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185572.760115:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789185572.760127:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789185572.760132:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821808896:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789185572.760138:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185572.760158:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821808896:12345-0@lo:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185572.760164:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789185572.760221:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821808896:0@lo:400:kworker.0 00000100:00100000:3.0:1789185572.760246:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821808768:0@lo:400:kworker.0 00000100:00100000:3.0:1789185572.760255:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821809280:0@lo:400:kworker.0 00000100:00100000:0.0:1789185572.760953:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821809152:0@lo:400:kworker.0 00000100:00100000:0.0:1789185572.761004:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185572.761058:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185572.761064:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821809024:0@lo:400:kworker.0 00000100:00100000:0.0:1789185572.761087:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185572.761186:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821809152 00000100:00100000:2.0:1789185572.761194:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821809152 00000100:00100000:2.0:1789185572.761253:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789185572.761262:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821809152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185572.761317:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821809152:12345-0@lo:400:kworker.0 Request processed in 56us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185572.761324:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1789185572.761370:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906b31c00 x1876096821809152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185572.761384:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821809152:0@lo:400:kworker.0 00000100:00080000:1.0:1789185572.761805:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185572.761958:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821809024 00000100:00100000:3.0:1789185572.761965:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821809024 00000100:00100000:3.0:1789185572.762064:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789185572.762072:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821809024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185572.762127:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821809024:12345-0@lo:400:kworker.0 Request processed in 56us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185572.762205:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789185572.762244:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821809024:0@lo:400:kworker.0 00000100:00080000:1.0:1789185572.762283:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789185573.019924:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185573.775963:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821809408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185573.776071:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185573.777169:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821809408 00000100:00100000:2.0:1789185573.777181:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821809408 00000100:00100000:2.0:1789185573.777284:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789185573.777295:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790833b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821809408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185573.777332:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185573.777399:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790833b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821809408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185573.777431:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789185573.777505:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906b31880 x1876096821809408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185573.777525:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821809408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789185574.031746:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185575.065846:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789185575.295968:0:11460:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:59:32 (1789185572) === 00000100:00100000:1.0:1789185575.477184:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185575.477229:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185575.477329:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812335488 00000100:00100000:2.0:1789185575.477340:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812335488 00000100:00100000:2.0:1789185575.477441:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:2.0:1789185575.477453:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790833b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:9708:x1876096812335488:12345-192.168.202.54@tcp:700:mkdir.0 00000100:00100000:2.0:1789185575.477537:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790833b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:9708:x1876096812335488:12345-192.168.202.54@tcp:700:mkdir.0 Request processed in 86us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185575.477546:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00080000:1.0:1789185575.477776:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185575.477957:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812335360 00000100:00100000:3.0:1789185575.477963:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812335360 00000100:00100000:3.0:1789185575.478015:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:3.0:1789185575.478024:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790833a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812335360:12345-192.168.202.54@tcp:41:mkdir.0 00000004:00000024:3.0:1789185575.478055:0:11024:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789185575.478155:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790833a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812335360:12345-192.168.202.54@tcp:41:mkdir.0 Request processed in 132us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185575.478163:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:0.0:1789185575.488025:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185575.488327:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812335744 00000100:00100000:2.0:1789185575.488337:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812335744 00000100:00100000:2.0:1789185575.488402:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:2.0:1789185575.488438:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:9708:x1876096812335744:12345-192.168.202.54@tcp:36:mkdir.0 00010000:00010000:2.0:1789185575.488495:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185575.488578:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272b966 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3ed expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.488597:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c791aedc000) 00010000:00010000:2.0:1789185575.488608:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185575.488924:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272ba85 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.488939:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272ba85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.488948:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272ba85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.488976:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272ba8c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.489004:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272ba8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.489011:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272ba8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185575.490168:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789185575.490183:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272ba85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.490191:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272ba85 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.490198:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272ba85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.490203:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185575.490207:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272ba85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.490214:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272ba85 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.490226:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334aa00) 00010000:00010000:2.0:1789185575.490229:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185575.490234:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272ba85 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.490240:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272ba85 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185575.490268:0:5822:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a0de3140 reply state 00000000c2ab0b7c transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272ba8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185575.490277:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185575.490399:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:9708:x1876096812335744:12345-192.168.202.54@tcp:36:mkdir.0 Request processed in 1961us (2382us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789185575.490434:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00010000:00010000:3.0:1789185575.494812:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272ba8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.494835:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272ba8c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.494844:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272ba8c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.494863:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185575.494869:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272ba8c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.494879:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272ba8c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.494903:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c792334a600) 00010000:00010000:3.0:1789185575.494906:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185575.494912:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272ba8c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.494919:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272ba8c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185575.504670:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185575.504826:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812335872 00000100:00100000:0.0:1789185575.504843:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812335872 00000100:00100000:0.0:1789185575.504916:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:0.0:1789185575.504928:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:9709:x1876096812335872:12345-192.168.202.54@tcp:101:chmod.0 00010000:00010000:0.0:1789185575.504958:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185575.505188:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272ba93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d472 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.505281:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272ba9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.505300:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272ba9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.505318:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272ba9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185575.505368:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789185575.505371:0:11024:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185575.505469:0:11024:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272ba9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.505501:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272ba93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d472 expref: 8 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.505543:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272ba9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d472 expref: 7 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.505552:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79117a4c00) 00010000:00010000:0.0:1789185575.505555:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185575.505560:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354600, rc 0) 00000100:00100000:0.0:1789185575.505662:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:9709:x1876096812335872:12345-192.168.202.54@tcp:101:chmod.0 Request processed in 736us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185575.505671:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:3.0:1789185575.512608:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185575.518395:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812336128 00000100:00100000:1.0:1789185575.518440:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812336128 00000100:00100000:1.0:1789185575.518572:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:1.0:1789185575.518590:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:9709:x1876096812336128:12345-192.168.202.54@tcp:36:chmod.0 00010000:00010000:1.0:1789185575.520168:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185575.520228:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272ba9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d472 expref: 7 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.520262:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79117a4c00) 00010000:00010000:1.0:1789185575.520291:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185575.520333:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272baa1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.520349:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272baa1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.520365:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272baa1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185575.522345:0:5822:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000379210a5 reply state 00000000c2ec14d9 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272baa1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185575.522371:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789185575.522385:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789185575.522579:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:9709:x1876096812336128:12345-192.168.202.54@tcp:36:chmod.0 Request processed in 3987us (9973us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789185575.522593:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00010000:00010000:1.0:1789185575.529334:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272baa1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.529360:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272baa1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.529391:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272baa1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.529398:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ed800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185575.529429:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272baa1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.529441:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272baa1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.529463:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c791aedc100) 00010000:00010000:1.0:1789185575.529467:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789185575.529474:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272baa1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.529481:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272baa1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185575.555243:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185575.555481:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812336256 00000100:00100000:2.0:1789185575.555500:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812336256 00000100:00100000:2.0:1789185575.555593:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:2.0:1789185575.555607:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:9710:x1876096812336256:12345-192.168.202.54@tcp:101:chown.0 00010000:00010000:2.0:1789185575.555654:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185575.555686:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272baa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d479 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.559511:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272baaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.559544:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272baaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.559574:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272baaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185575.559658:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789185575.559664:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789185575.559723:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272baaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.561520:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272baa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d479 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.561559:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272baaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d479 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.561569:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334aa00) 00010000:00010000:2.0:1789185575.561573:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185575.561577:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7a00, rc 0) 00000100:00100000:2.0:1789185575.561683:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:9710:x1876096812336256:12345-192.168.202.54@tcp:101:chown.0 Request processed in 6077us (6453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185575.561695:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:3.0:1789185575.571123:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185575.587593:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812336384 00000100:00100000:0.0:1789185575.587615:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812336384 00000100:00100000:0.0:1789185575.587716:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:0.0:1789185575.587729:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:9710:x1876096812336384:12345-192.168.202.54@tcp:101:chown.0 00010000:00010000:0.0:1789185575.587757:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185575.587797:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355400/0x532743011272bab6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d480 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.587887:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354c00/0x532743011272babd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.587906:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354c00/0x532743011272babd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.587919:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354c00/0x532743011272babd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.587935:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bac4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.587952:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.587959:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588248:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354400/0x532743011272bacb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588258:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354400/0x532743011272bacb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588266:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354400/0x532743011272bacb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185575.588305:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789185575.588310:0:5822:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185575.588337:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354400/0x532743011272bacb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588350:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354c00/0x532743011272babd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588358:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354c00/0x532743011272babd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588366:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354c00/0x532743011272babd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588373:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185575.588378:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354c00/0x532743011272babd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588394:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354c00/0x532743011272babd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588444:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334aa00) 00010000:00010000:0.0:1789185575.588448:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185575.588455:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354c00/0x532743011272babd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588462:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354c00/0x532743011272babd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588476:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588482:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bac4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588488:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bac4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588494:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185575.588497:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bac4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588503:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bac4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588510:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c79117a4300) 00010000:00010000:0.0:1789185575.588512:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185575.588515:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bac4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588530:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bac4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588571:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355400/0x532743011272bab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d480 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588587:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354400/0x532743011272bacb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d480 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.588594:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c79117a4400) 00010000:00010000:0.0:1789185575.588596:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185575.588599:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354400, rc 0) 00000100:00100000:0.0:1789185575.589071:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:9710:x1876096812336384:12345-192.168.202.54@tcp:101:chown.0 Request processed in 1340us (17959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185575.589082:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:1.0:1789185575.610160:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185575.611210:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812336640 00000100:00100000:3.0:1789185575.611234:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812336640 00000100:00100000:3.0:1789185575.611322:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:3.0:1789185575.611335:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:9710:x1876096812336640:12345-192.168.202.54@tcp:36:chown.0 00010000:00010000:3.0:1789185575.611435:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185575.611475:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354400/0x532743011272bacb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d480 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.611500:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c79117a4400) 00010000:00010000:3.0:1789185575.611513:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185575.612684:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272bad2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.612709:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272bad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.612723:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272bad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185575.720302:0:11024:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000019071830 reply state 0000000046c1a1b7 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272bad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185575.720323:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789185575.720337:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789185575.720476:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+10:9710:x1876096812336640:12345-192.168.202.54@tcp:36:chown.0 Request processed in 109138us (110324us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789185575.720486:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00010000:00010000:2.0:1789185575.723442:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272bad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.723465:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272bad2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.723474:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272bad2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.723481:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185575.723486:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272bad2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.723493:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272bad2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.723509:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c79055dd000) 00010000:00010000:2.0:1789185575.723528:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789185575.723534:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272bad2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.723540:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272bad2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185575.724698:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1789185575.724720:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000100:00100000:1.0:1789185575.741946:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185575.742772:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812336768 00000100:00100000:0.0:1789185575.742793:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812336768 00000100:00100000:1.0:1789185575.742943:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:1.0:1789185575.742973:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:9711:x1876096812336768:12345-192.168.202.54@tcp:101:touch.500 00010000:00010000:1.0:1789185575.743009:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185575.743032:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272bad9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d487 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789185575.744498:0:5823:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1411us 00010000:00010000:1.0:1789185575.759098:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272bae0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759124:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272bae0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759137:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272bae0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759154:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272bae7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759161:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272bae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759168:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272bae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759537:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed200/0x532743011272baee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759547:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed200/0x532743011272baee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759555:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed200/0x532743011272baee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185575.759580:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789185575.759584:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789185575.759625:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed200/0x532743011272baee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759638:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272bae0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759652:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272bae0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759659:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272bae0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759665:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ed800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185575.759670:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272bae0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759679:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272bae0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759691:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334aa00) 00010000:00010000:1.0:1789185575.759694:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185575.759699:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272bae0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759705:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272bae0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759717:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272bae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759724:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272bae7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759729:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272bae7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759734:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ec000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185575.759743:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272bae7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759750:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272bae7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759758:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c791aedc100) 00010000:00010000:1.0:1789185575.759760:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185575.759762:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272bae7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759768:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272bae7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759808:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272bad9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d487 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759822:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed200/0x532743011272baee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d487 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.759828:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:1.0:1789185575.759831:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789185575.759833:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013ed200, rc 0) 00000100:00100000:1.0:1789185575.759910:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:9711:x1876096812336768:12345-192.168.202.54@tcp:101:touch.500 Request processed in 16956us (17973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185575.759920:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:0.0:1789185575.764575:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185575.764689:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812337024 00000100:00100000:3.0:1789185575.764699:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812337024 00000100:00100000:3.0:1789185575.764760:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:3.0:1789185575.764771:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:9711:x1876096812337024:12345-192.168.202.54@tcp:101:touch.500 00010000:00010000:3.0:1789185575.764792:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185575.764813:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272baf5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d48e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.768270:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bafc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.768296:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bafc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.768325:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bafc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.768343:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bb03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.768350:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bb03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.768357:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bb03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789185575.769149:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789185575.769482:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272bb0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.769495:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272bb0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.769504:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272bb0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.769539:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bafc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.769546:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bafc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.769553:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bafc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.769559:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185575.769569:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bafc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.769576:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bafc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.769588:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:3.0:1789185575.769591:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185575.769596:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bafc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.769602:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bafc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185575.769615:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005c418a4f reply state 00000000d999130b transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bb03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185575.769624:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789185575.769663:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272baf5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d48e expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.769678:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272bb0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d48e expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.769686:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:3.0:1789185575.769688:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185575.769691:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04c00, rc 0) 00000100:00100000:3.0:1789185575.769774:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+10:9711:x1876096812337024:12345-192.168.202.54@tcp:101:touch.500 Request processed in 5004us (5207us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789185575.769783:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00010000:00010000:3.0:1789185575.777718:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bb03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.777736:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bb03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.777744:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bb03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.777750:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185575.777755:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bb03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.777763:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bb03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.777779:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd82be10b (ffff9c79055dd100) 00010000:00010000:3.0:1789185575.777782:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185575.777787:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bb03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.777793:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bb03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185575.779899:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185575.780086:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812337280 00000100:00100000:1.0:1789185575.780097:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812337280 00000100:00100000:1.0:1789185575.780162:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1789185575.780172:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:9711:x1876096812337280:12345-192.168.202.54@tcp:36:touch.500 00010000:00010000:1.0:1789185575.780245:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185575.780273:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272bb0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d48e expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.780293:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:1.0:1789185575.780304:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185575.780347:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bb18 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.780359:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bb18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185575.780368:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bb18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185575.780533:0:5822:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002d89a455 reply state 00000000ecc8ee04 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bb18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185575.780542:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789185575.780644:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+10:9711:x1876096812337280:12345-192.168.202.54@tcp:36:touch.500 Request processed in 473us (753us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789185575.780652:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00010000:00010000:2.0:1789185575.783064:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bb18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.783082:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bb18 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.783089:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bb18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.783096:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185575.783101:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bb18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.783110:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bb18 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.783126:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c791aedc100) 00010000:00010000:2.0:1789185575.783130:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185575.783135:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bb18 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185575.783141:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bb18 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185575.786139:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185575.786216:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812337408 00000100:00100000:3.0:1789185575.786226:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812337408 00000100:00100000:3.0:1789185575.786286:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:3.0:1789185575.786299:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:9711:x1876096812337408:12345-192.168.202.54@tcp:101:touch.500 00010000:00010000:3.0:1789185575.786323:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185575.786347:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bb1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d495 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.786466:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bb1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d495 expref: 10 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.786481:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bb1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d495 expref: 10 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.786499:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c79055dd100) 00010000:00010000:3.0:1789185575.786502:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789185575.786507:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04400, rc 0) 00000100:00100000:3.0:1789185575.786566:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+10:9711:x1876096812337408:12345-192.168.202.54@tcp:101:touch.500 Request processed in 270us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185575.786573:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:1.0:1789185575.791346:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185575.791435:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812337536 00000100:00100000:2.0:1789185575.791445:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812337536 00000100:00100000:2.0:1789185575.791495:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:2.0:1789185575.791507:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2368:x1876096812337536:12345-192.168.202.54@tcp:8:touch.500 00010000:00080000:2.0:1789185575.791542:0:6679:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:2.0:1789185575.791569:0:6679:0:(genops.c:1384:class_connect()) connect: client 19bfb1a3-97ed-41fd-ac10-946cffd5be7d, cookie 0x532743011272bb26 00002000:00100000:2.0:1789185575.791580:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 19bfb1a3-97ed-41fd-ac10-946cffd5be7d/ffff9c793f1cd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789185575.791602:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:2.0:1789185575.791829:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789185575.791856:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9c793f1cb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789185575.791918:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2368:x1876096812337536:12345-192.168.202.54@tcp:8:touch.500 Request processed in 414us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185575.791925:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:1.0:1789185575.795476:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185575.795613:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812337664 00000100:00100000:2.0:1789185575.795633:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812337664 00000100:00100000:2.0:1789185575.795715:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:2.0:1789185575.795725:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:0:x1876096812337664:12345-192.168.202.54@tcp:2:touch.500 00000100:00080000:1.0:1789185575.796581:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789185575.922778:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1789185575.922795:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000100:00100000:2.0:1789185575.927968:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:0:x1876096812337664:12345-192.168.202.54@tcp:2:touch.500 Request processed in 132233us (132489us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789185575.927992:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:3.0:1789185575.931747:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185575.934910:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812337920 00000100:00100000:2.0:1789185575.934926:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812337920 00000100:00100000:0.0:1789185575.941798:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:0.0:1789185575.941814:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+10:9711:x1876096812337920:12345-192.168.202.54@tcp:35:touch.500 00000100:00100000:0.0:1789185575.942180:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+11:9711:x1876096812337920:12345-192.168.202.54@tcp:35:touch.500 Request processed in 370us (10442us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789185575.942188:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:1.0:1789185575.961087:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185575.961195:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812338048 00000100:00100000:0.0:1789185575.961217:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812338048 00000100:00100000:0.0:1789185575.961279:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:0.0:1789185575.961290:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+11:9712:x1876096812338048:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:0.0:1789185575.961315:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185575.961335:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355400/0x532743011272bb2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d49c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.961470:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bb34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.961487:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bb34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.961500:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bb34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185575.961537:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789185575.961541:0:5822:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185575.961579:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bb34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.961605:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355400/0x532743011272bb2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d49c expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.962550:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bb34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d49c expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185575.962559:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:0.0:1789185575.962562:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185575.962566:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355c00, rc 0) 00000100:00100000:0.0:1789185575.964804:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:9712:x1876096812338048:12345-192.168.202.54@tcp:101:rm.0 Request processed in 3503us (3713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185575.964817:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1789185575.977617:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185575.977809:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812338304 00000100:00100000:3.0:1789185575.977820:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812338304 00000100:00100000:3.0:1789185575.977878:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:3.0:1789185575.977888:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:9712:x1876096812338304:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:3.0:1789185575.977908:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185575.977930:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bb3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d4a3 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185575.978034:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789185575.978200:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bb3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4a3 expref: 14 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.978225:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334aa00) 00010000:00010000:3.0:1789185575.978228:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185575.978234:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bb3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4a3 expref: 14 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185575.978246:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04200, rc 0) 00000100:00100000:3.0:1789185575.978313:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:9712:x1876096812338304:12345-192.168.202.54@tcp:101:rm.0 Request processed in 425us (705us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1789185575.978320:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:0.0:1789185575.985580:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185575.985763:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812338432 00000100:00100000:2.0:1789185575.985773:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812338432 00000100:00100000:2.0:1789185575.985835:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:2.0:1789185575.985844:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:9712:x1876096812338432:12345-192.168.202.54@tcp:37:rm.0 00000100:00100000:2.0:1789185575.990476:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:9712:x1876096812338432:12345-192.168.202.54@tcp:37:rm.0 Request processed in 4621us (4897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185575.990500:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:1.0:1789185576.002126:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185576.002800:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812338688 00000100:00100000:3.0:1789185576.002812:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812338688 00000100:00100000:3.0:1789185576.002931:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:3.0:1789185576.002943:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79191b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:9712:x1876096812338688:12345-192.168.202.54@tcp:35:rm.0 00000100:00100000:3.0:1789185576.003217:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79191b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:9712:x1876096812338688:12345-192.168.202.54@tcp:35:rm.0 Request processed in 272us (1099us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789185576.003224:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:1.0:1789185576.010488:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185576.010597:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812338944 00000100:00100000:2.0:1789185576.010607:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812338944 00000100:00100000:2.0:1789185576.010680:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:2.0:1789185576.010692:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:9712:x1876096812338944:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:2.0:1789185576.010718:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185576.010742:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7200/0x532743011272bb49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d4aa expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.010840:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272bb50 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.010854:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272bb50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.010867:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272bb50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185576.010878:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789185576.011022:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7200/0x532743011272bb49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4aa expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.011040:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272bb50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4aa expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.011048:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:2.0:1789185576.011051:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789185576.011054:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6600, rc 0) 00000100:00100000:2.0:1789185576.011127:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:9712:x1876096812338944:12345-192.168.202.54@tcp:101:rm.0 Request processed in 438us (650us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789185576.011135:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:1.0:1789185576.021789:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185576.023928:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812339072 00000100:00100000:3.0:1789185576.023943:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812339072 00000100:00100000:3.0:1789185576.024074:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:3.0:1789185576.024086:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:9712:x1876096812339072:12345-192.168.202.54@tcp:41:rm.0 00000004:00000024:3.0:1789185576.024147:0:11024:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1789185576.024233:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:9712:x1876096812339072:12345-192.168.202.54@tcp:41:rm.0 Request processed in 149us (2455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185576.024240:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:1.0:1789185576.033595:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185576.039073:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812339200 00000100:00100000:2.0:1789185576.039091:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812339200 00000100:00100000:0.0:1789185576.039499:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:0.0:1789185576.039513:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:9712:x1876096812339200:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:0.0:1789185576.039533:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185576.039555:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354c00/0x532743011272bb5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d4b1 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.039797:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bb65 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.039812:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bb65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.039824:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bb65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.039838:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bb6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.039845:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bb6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.039850:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bb6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.039957:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bb73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.039993:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bb73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040000:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bb73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185576.040027:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789185576.040031:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185576.040048:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bb73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040059:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bb73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040066:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bb65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040072:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bb65 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040078:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bb65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040083:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185576.040087:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bb65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040093:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bb65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040104:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:0.0:1789185576.040108:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185576.040120:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bb65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040126:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bb65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040138:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bb6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040144:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bb6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040149:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bb6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040154:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185576.040156:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bb6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040160:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bb6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040166:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd82be10b (ffff9c79117a4700) 00010000:00010000:0.0:1789185576.040168:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185576.040170:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bb6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040175:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bb6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040204:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354c00/0x532743011272bb5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4b1 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040228:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bb73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4b1 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.040235:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c79055dd100) 00010000:00010000:0.0:1789185576.040238:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185576.040240:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354a00, rc 0) 00000100:00100000:0.0:1789185576.040368:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+17:9712:x1876096812339200:12345-192.168.202.54@tcp:101:rm.0 Request processed in 858us (6783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185576.040376:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:1.0:1789185576.044602:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185576.044916:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812339456 00000100:00100000:2.0:1789185576.044926:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812339456 00000100:00100000:2.0:1789185576.045014:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:2.0:1789185576.045025:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+17:9712:x1876096812339456:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1789185576.045081:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789185576.045109:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bb73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4b1 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.045132:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bb1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d495 expref: 16 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.045142:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c79055dd100) 00010000:00010000:2.0:1789185576.045158:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272bb34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d49c expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.045165:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:2.0:1789185576.045168:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185576.045189:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7200/0x532743011272bb7a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.045203:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7200/0x532743011272bb7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.045212:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7200/0x532743011272bb7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.045241:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bb81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.045247:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bb81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.045253:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bb81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.045396:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bb88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.045538:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bb88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.045547:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bb88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789185576.047856:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789185576.047876:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 273087470117ns, next at 274087466729ns, rc = 0 00010000:00010000:2.0:1789185576.047961:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bb8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.047989:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bb8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048001:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bb8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048010:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bb8f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048035:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bb8f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048042:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bb8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048140:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789185576.048164:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bb88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048170:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bb88 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048177:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bb88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048182:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185576.048187:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bb88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048195:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bb88 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048206:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c792334a100) 00010000:00010000:2.0:1789185576.048209:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789185576.048214:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bb88 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048219:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bb88 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048241:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7200/0x532743011272bb7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048253:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7200/0x532743011272bb7a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048258:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7200/0x532743011272bb7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048263:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185576.048266:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7200/0x532743011272bb7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048272:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7200/0x532743011272bb7a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048281:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:2.0:1789185576.048283:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185576.048287:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7200/0x532743011272bb7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.048293:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7200/0x532743011272bb7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185576.048304:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e351d403 reply state 00000000d9ea90d4 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bb81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185576.048313:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185576.048448:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:9712:x1876096812339456:12345-192.168.202.54@tcp:36:rm.0 Request processed in 3420us (3851us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789185576.048458:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00010000:00010000:0.0:1789185576.051155:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bb81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.051174:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bb81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.051183:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bb81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.051190:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185576.051196:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bb81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.051204:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bb81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.051221:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd82be10b (ffff9c792334ae00) 00010000:00010000:0.0:1789185576.051224:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185576.051230:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bb81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.051253:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bb81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.051809:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185576.051818:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bb8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.051825:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6000 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185576.051830:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bb8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.051837:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bb8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.051849:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c792334a100) 00010000:00010000:1.0:1789185576.051852:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789185576.051856:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bb8f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.051861:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bb8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.051875:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185576.051877:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185576.051879:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185576.054721:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185576.055207:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812339712 00000100:00100000:2.0:1789185576.055218:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812339712 00000100:00100000:2.0:1789185576.055283:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:2.0:1789185576.055296:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:9712:x1876096812339712:12345-192.168.202.54@tcp:35:rm.0 00000100:00100000:2.0:1789185576.055582:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:9712:x1876096812339712:12345-192.168.202.54@tcp:35:rm.0 Request processed in 287us (872us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789185576.055591:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:2.0:1789185576.058854:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185576.058925:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812339968 00000100:00100000:1.0:1789185576.058934:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812339968 00000100:00100000:1.0:1789185576.058994:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:1.0:1789185576.059005:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:9712:x1876096812339968:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1789185576.059059:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789185576.059101:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272bb50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4aa expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.059124:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed200/0x532743011272baee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d487 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.059137:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:1.0:1789185576.059152:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272baaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d479 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.059161:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334aa00) 00010000:00010000:1.0:1789185576.059168:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185576.059192:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bb96 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.059203:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bb96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.059212:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bb96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.059224:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bb9d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.059230:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bb9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.059237:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bb9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.059530:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bba4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.059545:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bba4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.059552:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bba4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185576.060249:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789185576.060270:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bba4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.060278:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bba4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.060284:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bba4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.060291:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4dc00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185576.060295:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bba4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.060303:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bba4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.060315:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c791aedcf00) 00010000:00010000:1.0:1789185576.060318:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789185576.060321:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bba4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.060327:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bba4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.060346:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bb96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.060359:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bb96 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.060364:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bb96 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.060368:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185576.060372:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bb96 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.060378:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bb96 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.060385:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c791aedcb00) 00010000:00010000:1.0:1789185576.060387:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185576.060391:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bb96 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185576.060397:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bb96 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185576.060459:0:5822:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005a23f7e9 reply state 00000000aa175158 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bb9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185576.060469:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789185576.060559:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:9712:x1876096812339968:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1554us (1713us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789185576.060568:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00010000:00010000:2.0:1789185576.065008:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bb9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.065029:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bb9d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.065036:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bb9d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.065043:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4ce00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185576.065048:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bb9d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.065057:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bb9d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.065077:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c791aedc700) 00010000:00010000:2.0:1789185576.065080:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185576.065086:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bb9d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185576.065093:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bb9d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185576.081239:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185576.583314:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185576.583375:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185576.583458:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185576.583494:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185576.583526:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812340224 00000100:00100000:2.0:1789185576.583536:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812340224 00000100:00100000:2.0:1789185576.583583:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812340480 00000100:00100000:2.0:1789185576.583587:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812340480 00000100:00100000:2.0:1789185576.583641:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:2.0:1789185576.583653:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:2370:x1876096812340224:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185576.583729:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:2370:x1876096812340224:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185576.583737:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:2.0:1789185576.583755:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:2.0:1789185576.583762:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812340480:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185576.583787:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812340480:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 26us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185576.583793:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00080000:2.0:1789185576.583810:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185576.584400:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812340352 00000100:00100000:3.0:1789185576.584427:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812340352 00000100:00100000:3.0:1789185576.584471:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:3.0:1789185576.584479:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812340352:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185576.584531:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812340352:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 52us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185576.584537:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:0.0:1789185576.584677:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812340096 00000100:00100000:0.0:1789185576.584681:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812340096 00000100:00100000:0.0:1789185576.584720:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 249 00000100:00100000:0.0:1789185576.584727:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812340096:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185576.584764:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812340096:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 38us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185576.584772:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 249 00010000:00010000:0.0:1789185577.103618:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789185577.871955:0:7964:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 274911547238ns, next at 275911544818ns, rc = 0 00000100:00100000:3.0:1789185577.871993:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185577.872013:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821809536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185577.872082:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185577.872149:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821809536 00000100:00100000:3.0:1789185577.872157:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821809536 00000100:00100000:3.0:1789185577.872210:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789185577.872219:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821809536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185577.872251:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185577.872292:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821809536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185577.872299:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1789185577.872319:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789185577.872346:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906b31f80 x1876096821809536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185577.872364:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821809536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185577.874812:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821809920:0@lo:400:kworker.0 00000100:00100000:1.0:1789185577.874880:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185577.874935:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789185577.874941:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821809792:0@lo:400:kworker.0 00000100:00100000:1.0:1789185577.874972:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185577.875006:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821809920 00000100:00100000:1.0:1789185577.875015:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821809920 00000100:00100000:1.0:1789185577.875064:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821809792 00000100:00100000:1.0:1789185577.875067:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821809792 00000100:00100000:1.0:1789185577.875086:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789185577.875094:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821809920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185577.875143:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821809920:12345-0@lo:400:kworker.0 Request processed in 50us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185577.875151:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789185577.875168:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789185577.875174:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821809792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185577.875200:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821809792:12345-0@lo:400:kworker.0 Request processed in 27us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185577.875206:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789185577.875251:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821809792:0@lo:400:kworker.0 00000100:00100000:1.0:1789185577.875262:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821809920:0@lo:400:kworker.0 00000100:00100000:0.0:1789185577.875462:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821810048:0@lo:400:kworker.0 00000100:00100000:0.0:1789185577.875495:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185577.875514:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789185577.875520:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821809664:0@lo:400:kworker.0 00000100:00100000:0.0:1789185577.875546:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185577.875570:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821810176:0@lo:400:kworker.0 00000100:00100000:0.0:1789185577.875592:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185577.875627:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821810176 00000100:00100000:0.0:1789185577.875630:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821810176 00000100:00100000:0.0:1789185577.875660:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789185577.875666:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821810176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185577.875698:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821810176:12345-0@lo:400:kworker.0 Request processed in 33us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185577.875716:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789185577.875744:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821810176:0@lo:400:kworker.0 00000100:00100000:3.0:1789185577.875939:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821809664 00000100:00100000:3.0:1789185577.875944:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821809664 00000100:00100000:3.0:1789185577.875990:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789185577.876004:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821809664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185577.876046:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821809664:12345-0@lo:400:kworker.0 Request processed in 43us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185577.876051:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:3.0:1789185577.876077:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185577.876092:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821809664:0@lo:400:kworker.0 00000100:00100000:1.0:1789185577.876250:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821810048 00000100:00100000:1.0:1789185577.876254:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821810048 00000100:00080000:3.0:1789185577.876343:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185577.876372:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789185577.876389:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821810048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185577.876458:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821810048:12345-0@lo:400:kworker.0 Request processed in 80us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185577.876464:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1789185577.876524:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793ff95f80 x1876096821810048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185577.876535:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821810048:0@lo:400:kworker.0 00010000:00010000:1.0:1789185578.127645:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185578.897236:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821810304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185578.897313:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185578.899097:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821810304 00000100:00100000:2.0:1789185578.899114:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821810304 00000100:00100000:2.0:1789185578.899182:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789185578.899193:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821810304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185578.899228:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185578.899310:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821810304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185578.899317:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1789185578.900204:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7906b31f80 x1876096821810304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185578.900228:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821810304:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789185579.153875:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789185580.038993:0:11610:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1789185580.177262:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789185581.025963:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967302 is committed 00000001:00080000:2.0:1789185581.025990:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1789185581.026018:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789185581.026152:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789185581.026173:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821810432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789185581.026247:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185581.027002:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821810432 00000100:00100000:2.0:1789185581.027011:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821810432 00000100:00100000:2.0:1789185581.027080:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789185581.027090:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821810432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789185581.027116:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789185581.027155:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa4ce27, atime: 0x6aa4ce27, ctime: 0x6aa4ce27, blocks: 0x1 00010000:00010000:2.0:1789185581.027163:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cd99d26/0x532743011272bbab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.027180:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=278s v=(0 0) 00010000:00010000:2.0:1789185581.027185:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185581.027192:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cd99d26/0x532743011272bbab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.027208:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cd99d26/0x532743011272bbab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.027220:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cd99d26/0x532743011272bbab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.027229:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cd99d26/0x532743011272bbab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.027255:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1789185581.027902:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185581.029237:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1876096821810432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2144us (2984us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789185581.029248:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789185581.029277:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185581.029284:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cd99d26/0x532743011272bbab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.029295:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6600 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185581.029300:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cd99d26/0x532743011272bbab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.029310:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cd99d26/0x532743011272bbab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.029341:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cd99d26/0x532743011272bbab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.029349:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cd99d26/0x532743011272bbab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.029366:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185581.029369:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185581.029370:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789185581.029382:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:3.0:1789185581.030175:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c793f25fb80/2, rc 0, transno 4294967300 00000100:00100000:3.0:1789185581.030184:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821810432:0@lo:6:osp-syn-1-0.0 00000020:00000080:1.0:1789185581.043248:0:11660:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe95e36b60 20000000:00000080:1.0:1789185581.043264:0:11660:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c792fafbc00 uarg=0000000000000000 20000000:01000000:1.0:1789185581.043294:0:11660:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789185581.043301:0:11660:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789185581.043377:0:11660:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789185581.044862:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789185581.045051:0:11660:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1789185581.050304:0:11660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1789185581.050385:0:11660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1789185581.050494:0:11660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1789185581.050514:0:11660:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789185581.050547:0:11660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c793fe04200/0x532743011272bbb2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.050641:0:11660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79013eda00/0x532743011272ba54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ba4d expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.050650:0:11660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79013ec800/0x532743011272ba62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ba5b expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.050675:0:11660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79234d6200/0x532743011272ba70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ba69 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.050685:0:11660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79013ece00/0x532743011272ba77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d464 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.050694:0:11660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7907355000/0x532743011272ba7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d46b expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.050701:0:11660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c793fe04200/0x532743011272bbb2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.050879:0:11660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7907355000/0x532743011272ba7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d46b expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.050898:0:11660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7907355000/0x532743011272ba7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d46b expref: 12 pid: 5816 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185581.050914:0:11660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1876096821810560:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185581.051040:0:11660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79013ece00/0x532743011272ba77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d464 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.051049:0:11660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c79013ece00/0x532743011272ba77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d464 expref: 12 pid: 5815 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185581.051058:0:11660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1876096821810688:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185581.051091:0:11660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79234d6200/0x532743011272ba70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272ba69 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.051111:0:11660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c79234d6200/0x532743011272ba70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272ba69 expref: 18 pid: 5816 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185581.051121:0:11660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1876096821810816:0@lo:104: 00000100:00100000:3.0:1789185581.051165:0:11660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789185581.051206:0:11660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79013ec800/0x532743011272ba62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272ba5b expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.051215:0:11660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c79013ec800/0x532743011272ba62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272ba5b expref: 18 pid: 5816 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185581.051223:0:11660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1876096821810944:0@lo:104: 00000100:00100000:3.0:1789185581.051246:0:11660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789185581.051269:0:11660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79013eda00/0x532743011272ba54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272ba4d expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.051278:0:11660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c79013eda00/0x532743011272ba54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272ba4d expref: 18 pid: 5816 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185581.051286:0:11660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1876096821811072:0@lo:104: 00000100:00100000:3.0:1789185581.051309:0:11660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185581.051320:0:11660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79103c1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185581.053481:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789185581.053515:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821810816 00000100:00100000:2.0:1789185581.053523:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821810816 00000100:00100000:2.0:1789185581.053562:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821810944 00000100:00100000:2.0:1789185581.053565:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821810944 00000100:00100000:2.0:1789185581.053575:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821811072 00000100:00100000:2.0:1789185581.053578:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821811072 00000100:00100000:2.0:1789185581.053595:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789185581.054814:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+5:11660:x1876096821810816:12345-0@lo:104: 00010000:00010000:2.0:1789185581.054836:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c79013ed000/0x532743011272ba69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ba70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.054928:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789185581.054945:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+5:11660:x1876096821810816:12345-0@lo:104: Request processed in 1342us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185581.054952:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789185581.054975:0:11660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906616d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1876096821810816:0@lo:104: 00000100:00100000:2.0:1789185581.054978:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789185581.054986:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+4:11660:x1876096821810944:12345-0@lo:104: 00010000:00010000:2.0:1789185581.054993:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c79234d7600/0x532743011272ba5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ba62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.055042:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789185581.055048:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+4:11660:x1876096821810944:12345-0@lo:104: Request processed in 64us (3802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185581.055054:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789185581.055058:0:11660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1876096821810944:0@lo:104: 00000100:00100000:2.0:1789185581.055067:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789185581.055073:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79082fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+3:11660:x1876096821811072:12345-0@lo:104: 00010000:00010000:2.0:1789185581.055081:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272ba4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ba54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185581.055094:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185581.055101:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c79013ed000/0x532743011272ba69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ba70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185581.055107:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ed000 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:0.0:1789185581.055111:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c79013ed000/0x532743011272ba69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272ba70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185581.055120:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79013ed000/0x532743011272ba69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272ba70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185581.055127:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79013ed000/0x532743011272ba69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272ba70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.055133:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:01000000:0.0:1789185581.055133:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789185581.055138:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79082fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+3:11660:x1876096821811072:12345-0@lo:104: Request processed in 66us (3828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185581.055144:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789185581.055166:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c79013ed000/0x532743011272ba69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ba70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.055179:0:11163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185581.055182:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185581.055183:0:11163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c79234d7600/0x532743011272ba5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ba62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.055189:0:11163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7600 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:2.0:1789185581.055192:0:11163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c79234d7600/0x532743011272ba5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272ba62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.055199:0:11163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79234d7600/0x532743011272ba5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272ba62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185581.055201:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c79013ed000/0x532743011272ba69 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ba70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185581.055207:0:11163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79234d7600/0x532743011272ba5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272ba62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185581.055208:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79013ed000/0x532743011272ba69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ba70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185581.055212:0:11163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789185581.055220:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185581.055223:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272ba4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ba54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.055226:0:11163:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c79234d7600/0x532743011272ba5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ba62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185581.055228:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05c00 already unused, calling callback (ffffffffc1d41c20) 00010000:00010000:2.0:1789185581.055231:0:11163:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789185581.055232:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272ba4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272ba54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.055237:0:11163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c79234d7600/0x532743011272ba5b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ba62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185581.055239:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272ba4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272ba54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.055243:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79234d7600/0x532743011272ba5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ba62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185581.055245:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272ba4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272ba54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185581.055250:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789185581.055260:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272ba4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ba54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.055261:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185581.055262:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185581.055264:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185581.055266:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185581.055278:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272ba4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ba54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185581.055285:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272ba4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ba54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185581.055302:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185581.055303:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185581.055305:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185581.055312:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185581.055338:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821811200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185581.055373:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185581.055438:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185581.055444:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821811328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185581.055464:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185581.055489:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821811456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185581.055510:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185581.055703:0:11660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1876096821810560:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185581.055723:0:11660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1876096821810688:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185581.055731:0:11660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1876096821811072:0@lo:104: 00010000:00010000:3.0:1789185581.055876:0:11660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c793fe04200/0x532743011272bbb2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185581.056707:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821811200 00000100:00100000:2.0:1789185581.056716:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821811200 00010000:00010000:2.0:1789185581.056899:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79234d6200/0x532743011272ba70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ba69 expref: 19 pid: 5816 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185581.056941:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821811328 00000100:00100000:2.0:1789185581.056945:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821811328 00010000:00010000:2.0:1789185581.056956:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79013ec800/0x532743011272ba62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ba5b expref: 20 pid: 5816 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185581.056968:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821811456 00000100:00100000:2.0:1789185581.056970:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821811456 00010000:00010000:2.0:1789185581.056980:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79013eda00/0x532743011272ba54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ba4d expref: 21 pid: 5816 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185581.056991:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789185581.056998:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+21:3280:x1876096821811200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789185581.057009:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185581.057014:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79234d6200/0x532743011272ba70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ba69 expref: 21 pid: 5816 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.057024:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79234d6200/0x532743011272ba70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272ba69 expref: 21 pid: 5816 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.057040:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d6200/0x532743011272ba70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272ba69 expref: 21 pid: 5816 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185581.057055:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1789185581.057061:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185581.057062:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ad68fcc-785c-4134-99e9-eee8a8012753+20:3280:x1876096821811328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185581.057070:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185581.057075:0:6692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79013ec800/0x532743011272ba62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ba5b expref: 20 pid: 5816 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.057082:0:6692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79013ec800/0x532743011272ba62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272ba5b expref: 20 pid: 5816 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.057091:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79013ec800/0x532743011272ba62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272ba5b expref: 20 pid: 5816 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.057100:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185581.057106:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821811200:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185581.057113:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185581.057120:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3280:x1876096821811328:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185581.057126:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789185581.057129:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789185581.057135:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791f906050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+17:3278:x1876096821811456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789185581.057141:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185581.057146:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79013eda00/0x532743011272ba54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ba4d expref: 17 pid: 5816 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.057154:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79013eda00/0x532743011272ba54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272ba4d expref: 17 pid: 5816 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.057164:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79013eda00/0x532743011272ba54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272ba4d expref: 17 pid: 5816 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.057172:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185581.059201:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791f906050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ad68fcc-785c-4134-99e9-eee8a8012753+16:3278:x1876096821811456:12345-0@lo:103:ldlm_bl.0 Request processed in 2055us (3679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185581.059206:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821811456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185581.059216:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789185581.059290:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821811328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185581.059296:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821811200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185581.067582:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185581.067789:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185581.068394:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812340608 00000100:00100000:3.0:1789185581.068426:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812340608 00010000:00010000:3.0:1789185581.068468:0:6692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7907355000/0x532743011272ba7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d46b expref: 13 pid: 5816 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185581.068500:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812340736 00000100:00100000:3.0:1789185581.068504:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812340736 00000100:00100000:1.0:1789185581.069719:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:1.0:1789185581.069745:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5241da3d-acea-4d5e-9360-a7cef404ad9c+14:2372:x1876096812340608:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185581.069766:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185581.069774:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7907355000/0x532743011272ba7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d46b expref: 14 pid: 5816 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185581.069793:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7907355000/0x532743011272ba7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d46b expref: 14 pid: 5816 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185581.069810:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7907355000/0x532743011272ba7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d46b expref: 14 pid: 5816 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185581.069825:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185581.069896:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2372:x1876096812340608:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 165us (2326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185581.069904:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00010000:00010000:3.0:1789185581.071144:0:6692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79013ece00/0x532743011272ba77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d464 expref: 12 pid: 5815 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185581.071209:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:3.0:1789185581.071221:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:2371:x1876096812340736:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185581.071237:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185581.071243:0:6692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79013ece00/0x532743011272ba77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d464 expref: 12 pid: 5815 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.071256:0:6692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79013ece00/0x532743011272ba77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d464 expref: 12 pid: 5815 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.071272:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79013ece00/0x532743011272ba77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d464 expref: 12 pid: 5815 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.071287:0:6692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c793fe04200/0x532743011272bbb2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.071296:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe04200/0x532743011272bbb2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.071312:0:6692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c793fe04200/0x532743011272bbb2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.071333:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c793fe04200/0x532743011272bbb2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.071339:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c793fe04200/0x532743011272bbb2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.071346:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c793fe04200/0x532743011272bbb2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.071363:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185581.071368:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c793fe04200/0x532743011272bbb2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.071383:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c793fe04200/0x532743011272bbb2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.071401:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c793fe04200/0x532743011272bbb2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.071428:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185581.071476:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:2371:x1876096812340736:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 258us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185581.071484:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 34 00010000:00010000:3.0:1789185581.071514:0:11660:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c793fe04200/0x532743011272bbb2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.071535:0:11660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c793fe04200/0x532743011272bbb2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185581.071542:0:11660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c793fe04200/0x532743011272bbb2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185581.203056:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185581.706638:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185581.706694:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185581.706739:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185581.706777:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185581.706810:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812341120 00000100:00100000:2.0:1789185581.706819:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812341120 00000100:00100000:2.0:1789185581.706880:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:2.0:1789185581.706892:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812341120:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185581.706975:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812341120:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 85us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185581.706984:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:1.0:1789185581.707166:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812340992 00000100:00100000:1.0:1789185581.707172:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812340992 00000100:00100000:1.0:1789185581.707201:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812341248 00000100:00100000:1.0:1789185581.707205:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812341248 00000100:00100000:1.0:1789185581.707224:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:1.0:1789185581.707231:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812340992:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185581.707271:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812340992:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 41us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185581.707278:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:1.0:1789185581.707293:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:1.0:1789185581.707300:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812341248:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185581.707322:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812341248:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 24us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185581.707328:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:0.0:1789185581.707697:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812340864 00000100:00100000:0.0:1789185581.707703:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812340864 00000100:00100000:0.0:1789185581.707746:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 251 00000100:00100000:0.0:1789185581.707755:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:2370:x1876096812340864:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185581.707784:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:2370:x1876096812340864:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 31us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185581.707791:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 251 00000100:00080000:3.0:1789185581.713332:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185581.713343:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789185582.223673:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185582.919699:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185582.920029:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812341376 00000100:00100000:0.0:1789185582.920045:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812341376 00000100:00100000:0.0:1789185582.920139:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 252 00000100:00100000:0.0:1789185582.920154:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:5614:x1876096812341376:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185582.920181:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185582.920218:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7907354c00/0x532743011272bbb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d4b8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.920308:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7907354c00/0x532743011272bbb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4b8 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.920323:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7907354c00/0x532743011272bbb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4b8 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.920335:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354c00, rc 0) 00000100:00100000:0.0:1789185582.920472:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:5614:x1876096812341376:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 322us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.920479:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 252 00000100:00100000:2.0:1789185582.930219:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185582.930492:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812341504 00000100:00100000:1.0:1789185582.930506:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812341504 00000100:00100000:1.0:1789185582.930587:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 253 00000100:00100000:1.0:1789185582.930600:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:5614:x1876096812341504:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185582.931104:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:5614:x1876096812341504:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 504us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.931114:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 253 00000100:00100000:2.0:1789185582.934509:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185582.934880:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812341632 00000100:00100000:1.0:1789185582.934895:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812341632 00000100:00100000:1.0:1789185582.935030:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 254 00000100:00100000:1.0:1789185582.935043:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:5614:x1876096812341632:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185582.935359:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:5614:x1876096812341632:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 318us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.935369:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 254 00000100:00100000:2.0:1789185582.947366:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185582.947587:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812341760 00000100:00100000:0.0:1789185582.947601:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812341760 00000100:00100000:0.0:1789185582.947679:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 255 00000100:00100000:0.0:1789185582.947693:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:9982:x1876096812341760:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789185582.948459:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:9982:x1876096812341760:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 585us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.948472:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 255 00000100:00100000:2.0:1789185582.964500:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185582.965037:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812341888 00000100:00100000:1.0:1789185582.965052:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812341888 00000100:00100000:1.0:1789185582.965228:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 256 00000100:00100000:1.0:1789185582.965241:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:9982:x1876096812341888:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789185582.965868:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:9982:x1876096812341888:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 565us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.965881:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 256 00000100:00100000:2.0:1789185582.974062:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185582.974201:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812342016 00000100:00100000:0.0:1789185582.974215:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812342016 00000100:00100000:0.0:1789185582.974299:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 257 00000100:00100000:0.0:1789185582.974312:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:5614:x1876096812342016:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185582.974337:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185582.974362:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7907355c00/0x532743011272bbc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d4bf expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.974403:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7907355c00/0x532743011272bbc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4bf expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.974464:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7907355c00/0x532743011272bbc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4bf expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.974477:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355c00, rc 0) 00000100:00100000:0.0:1789185582.974567:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:5614:x1876096812342016:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 258us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.974575:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 257 00000100:00100000:2.0:1789185582.989955:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185582.990758:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812342144 00000100:00100000:1.0:1789185582.990774:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812342144 00000100:00100000:1.0:1789185582.990867:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 258 00000100:00100000:1.0:1789185582.990879:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:5614:x1876096812342144:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185582.991314:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:5614:x1876096812342144:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 434us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.991324:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 258 00000100:00100000:1.0:1789185582.994575:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821811584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185582.994676:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185582.995022:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821811584 00000100:00100000:0.0:1789185582.995035:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821811584 00000100:00100000:0.0:1789185582.995104:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789185582.995114:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1876096821811584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185582.995162:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789185582.995223:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1876096821811584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.995232:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789185582.995296:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821811584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185582.995478:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185582.997149:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812342272 00000100:00100000:0.0:1789185582.997166:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812342272 00000100:00100000:0.0:1789185582.997251:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 259 00000100:00100000:0.0:1789185582.997262:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:5614:x1876096812342272:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185582.997624:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:5614:x1876096812342272:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 363us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.997634:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 259 00000100:00100000:3.0:1789185582.998130:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821811968:0@lo:400:kworker.0 00000100:00100000:3.0:1789185582.998199:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185582.998243:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185582.998249:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821812096:0@lo:400:kworker.0 00000100:00100000:3.0:1789185582.998291:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185582.998323:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821812096 00000100:00100000:3.0:1789185582.998330:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821812096 00000100:00100000:3.0:1789185582.998381:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789185582.998390:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821812096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185582.998471:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821812096:12345-0@lo:400:kworker.0 Request processed in 83us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185582.998478:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789185582.998500:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789185582.998532:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbea00 x1876096821812096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185582.998565:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821812096:0@lo:400:kworker.0 00000100:00100000:1.0:1789185582.998740:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821811840:0@lo:400:kworker.0 00000100:00100000:1.0:1789185582.998778:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185582.998820:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789185582.998826:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821811712:0@lo:400:kworker.0 00000100:00100000:1.0:1789185582.998856:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185582.998884:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821812224:0@lo:400:kworker.0 00000100:00100000:1.0:1789185582.998906:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185582.998951:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821811968 00000100:00100000:1.0:1789185582.998956:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821811968 00000100:00100000:1.0:1789185582.998991:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821811840 00000100:00100000:1.0:1789185582.998994:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821811840 00000100:00100000:1.0:1789185582.999021:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821812224 00000100:00100000:1.0:1789185582.999023:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821812224 00000100:00100000:1.0:1789185582.999037:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789185582.999045:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821811968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185582.999089:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821811968:12345-0@lo:400:kworker.0 Request processed in 44us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.999095:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789185582.999110:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789185582.999115:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821811840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185582.999147:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821811840:12345-0@lo:400:kworker.0 Request processed in 32us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.999153:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789185582.999165:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789185582.999171:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821812224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185582.999196:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821812224:12345-0@lo:400:kworker.0 Request processed in 25us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.999201:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789185582.999237:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821812224:0@lo:400:kworker.0 00000100:00100000:1.0:1789185582.999247:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821811840:0@lo:400:kworker.0 00000100:00100000:1.0:1789185582.999276:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821811712 00000100:00100000:1.0:1789185582.999280:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821811712 00000100:00100000:1.0:1789185582.999303:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789185582.999309:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+16:3281:x1876096821811712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185582.999343:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+16:3281:x1876096821811712:12345-0@lo:400:kworker.0 Request processed in 35us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.999359:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789185582.999397:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821811712:0@lo:400:kworker.0 00000100:00080000:3.0:1789185583.002466:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185583.002572:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821811968:0@lo:400:kworker.0 00000100:00100000:2.0:1789185583.003126:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185583.003261:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812342400 00000100:00100000:0.0:1789185583.003290:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812342400 00000100:00100000:0.0:1789185583.003357:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 261 00000100:00100000:0.0:1789185583.003369:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:9985:x1876096812342400:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789185583.003726:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:9985:x1876096812342400:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 357us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185583.003736:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 261 00000100:00100000:2.0:1789185583.008061:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185583.008199:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812342528 00000100:00100000:0.0:1789185583.008213:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812342528 00000100:00100000:0.0:1789185583.008285:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 262 00000100:00100000:0.0:1789185583.008299:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:9985:x1876096812342528:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789185583.014059:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:9985:x1876096812342528:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 5743us (5993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185583.014080:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 262 10000000:01000000:0.0:1789185583.058133:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789185583.058144:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c793f2ba800 from 7 10000000:01000000:0.0:1789185583.058151:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789185583.058220:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185583.058236:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185583.058249:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185583.058293:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821812352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185583.058389:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185583.058478:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7930940240 going to sleep for 11 seconds 00000100:00100000:2.0:1789185583.059023:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821812352 00000100:00100000:2.0:1789185583.059034:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821812352 00000100:00100000:2.0:1789185583.059102:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789185583.059114:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+16:5820:x1876096821812352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185583.059133:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185583.059151:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d7200/0x532743011272bbce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272bbc7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185583.059195:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d7200/0x532743011272bbce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272bbc7 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185583.059208:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d7200/0x532743011272bbce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272bbc7 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185583.059219:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7200, rc 0) 00000100:00100000:2.0:1789185583.059291:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821812352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185583.059298:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789185583.060567:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821812352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185583.060606:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272bbce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185583.060619:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272bbce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185583.060739:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821812480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185583.061096:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185583.061167:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7930940240 going to sleep for 11 seconds 00000100:00100000:2.0:1789185583.061357:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821812480 00000100:00100000:2.0:1789185583.061367:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821812480 00000100:00100000:2.0:1789185583.061455:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789185583.061468:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821812480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185583.062316:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821812480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 845us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185583.062328:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789185583.063066:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821812480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185583.063140:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821812608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185583.063216:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185583.063266:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7930940240 going to sleep for 11 seconds 00000100:00100000:3.0:1789185583.063384:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821812608 00000100:00100000:3.0:1789185583.063392:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821812608 00000100:00100000:3.0:1789185583.063482:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789185583.063492:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821812608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185583.063736:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821812608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185583.063744:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789185583.064374:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821812608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185583.075172:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:11674:1876096821812736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185583.075325:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185583.075389:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7930940300 going to sleep for 11 seconds 00000100:00100000:2.0:1789185583.076066:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821812736 00000100:00100000:2.0:1789185583.076079:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821812736 00000100:00100000:2.0:1789185583.076143:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789185583.076154:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:11674:x1876096821812736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185583.076505:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:11674:x1876096821812736:12345-0@lo:502:llog_process_th.0 Request processed in 350us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185583.076516:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789185583.077181:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:11674:1876096821812736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185583.077231:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185583.077244:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185583.077246:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789185583.077254:0:11674:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c793f2ba800 00000020:00000080:0.0:1789185583.077257:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789185583.077384:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:11674:1876096821812864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185583.077484:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185583.078200:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79056b1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185583.090398:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821812864 00000100:00100000:1.0:1789185583.090432:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821812864 00000100:00100000:1.0:1789185583.090515:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789185583.090529:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+17:11674:x1876096821812864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185583.091191:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+17:11674:x1876096821812864:12345-0@lo:502:llog_process_th.0 Request processed in 663us (13703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185583.091202:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789185583.091523:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:11674:1876096821812864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185583.091579:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185583.091590:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185583.091593:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789185583.091598:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789185583.093104:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789185583.093155:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789185583.093169:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272bbce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185583.093186:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272bbce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185583.093198:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789185583.093202:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c791f9b0000 from 7 10000000:01000000:1.0:1789185583.093205:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789185583.093254:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185583.093263:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185583.093275:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185583.093321:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821812992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789185583.093400:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185583.093492:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791035b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185583.095109:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821812992 00000100:00100000:2.0:1789185583.095124:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821812992 00000100:00100000:2.0:1789185583.095196:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789185583.095208:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:5820:x1876096821812992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185583.095229:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185583.095253:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d7a00/0x532743011272bbdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272bbd5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185583.095287:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d7a00/0x532743011272bbdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272bbd5 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185583.095300:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d7a00/0x532743011272bbdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272bbd5 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185583.095311:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7a00, rc 0) 00000100:00100000:2.0:1789185583.095395:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821812992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185583.095402:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789185583.097021:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821812992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185583.097056:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272bbdc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185583.097072:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272bbdc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185583.097188:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821813120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185583.097261:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185583.097326:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791035b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185583.097362:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821813120 00000100:00100000:1.0:1789185583.097369:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821813120 00000100:00100000:1.0:1789185583.097452:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789185583.097463:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821813120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185583.099078:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821813120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1606us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185583.099094:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789185583.108069:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821813120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185583.108169:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821813248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185583.108289:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185583.108349:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79056b1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185583.108469:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821813248 00000100:00100000:1.0:1789185583.108477:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821813248 00000100:00100000:1.0:1789185583.108541:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789185583.108553:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821813248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185583.109115:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821813248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 562us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185583.109133:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789185583.109527:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821813248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185583.110255:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:11677:1876096821813376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185583.110332:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185583.110383:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79056b1540 going to sleep for 11 seconds 00000100:00100000:1.0:1789185583.110447:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821813376 00000100:00100000:1.0:1789185583.110455:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821813376 00000100:00100000:1.0:1789185583.110500:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789185583.110510:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:11677:x1876096821813376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185583.111158:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:11677:x1876096821813376:12345-0@lo:502:llog_process_th.0 Request processed in 646us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185583.111168:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789185583.118740:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:11677:1876096821813376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185583.118957:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185583.118973:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185583.118975:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789185583.118985:0:11677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c791f9b0000 00000020:00000080:0.0:1789185583.118989:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789185583.119122:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:11677:1876096821813504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185583.119230:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185583.119291:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79056b1540 going to sleep for 11 seconds 00000100:00100000:1.0:1789185583.119373:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821813504 00000100:00100000:1.0:1789185583.119382:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821813504 00000100:00100000:1.0:1789185583.119477:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789185583.119488:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+18:11677:x1876096821813504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185583.119796:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+18:11677:x1876096821813504:12345-0@lo:502:llog_process_th.0 Request processed in 308us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185583.119804:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789185583.120089:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:11677:1876096821813504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185583.120130:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185583.120137:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185583.120139:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789185583.120144:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000040:00080000:2.0:1789185583.121018:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:1.0:1789185583.121450:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789185583.121476:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789185583.121490:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272bbdc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185583.121506:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272bbdc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185583.121519:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789185583.121522:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c79102db000 from 7 10000000:01000000:1.0:1789185583.121526:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789185583.121574:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185583.121597:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185583.121611:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185583.121641:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821813632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789185583.121729:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185583.121953:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821813632 00000100:00100000:0.0:1789185583.121962:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821813632 00000100:00100000:0.0:1789185583.122020:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789185583.122030:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+18:5820:x1876096821813632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185583.122045:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185583.122061:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7907354400/0x532743011272bbea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272bbe3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185583.122092:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7907354400/0x532743011272bbea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272bbe3 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185583.122104:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7907354400/0x532743011272bbea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272bbe3 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185583.122113:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354400, rc 0) 00000100:00100000:0.0:1789185583.122155:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821813632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185583.122162:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789185583.122723:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c794125ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185583.122753:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821813632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185583.122880:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272bbea expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185583.122893:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272bbea expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185583.122971:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821813760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185583.123009:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185583.123028:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c794125ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185583.123049:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821813760 00000100:00100000:1.0:1789185583.123054:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821813760 00000100:00100000:1.0:1789185583.123080:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789185583.123088:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821813760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185583.123427:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821813760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 318us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185583.123435:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789185583.123477:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821813760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185583.123506:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821813888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185583.123546:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185583.123557:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c794125ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185583.123576:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821813888 00000100:00100000:1.0:1789185583.123580:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821813888 00000100:00100000:1.0:1789185583.123599:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789185583.123605:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821813888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185583.127591:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:5820:x1876096821813888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3970us (4028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185583.127611:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789185583.135218:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ad68fcc-785c-4134-99e9-eee8a8012753:5820:1876096821813888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185583.136055:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:11680:1876096821814016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185583.136160:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185583.136226:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79056b1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185583.136366:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821814016 00000100:00100000:3.0:1789185583.136376:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821814016 00000100:00100000:3.0:1789185583.136462:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789185583.136475:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:11680:x1876096821814016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185583.136981:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:11680:x1876096821814016:12345-0@lo:502:llog_process_th.0 Request processed in 507us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185583.136997:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789185583.137147:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:11680:1876096821814016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185583.137188:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185583.137199:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185583.137201:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789185583.137221:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c79102db000 00000020:00000080:0.0:1789185583.137224:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789185583.137616:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:11680:1876096821814144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185583.137668:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185583.137688:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79056b1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185583.139144:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821814144 00000100:00100000:1.0:1789185583.139162:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821814144 00000100:00100000:1.0:1789185583.142348:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789185583.142381:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:11680:x1876096821814144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185583.145110:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ad68fcc-785c-4134-99e9-eee8a8012753:11680:1876096821814144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185583.145170:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185583.145180:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185583.145183:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789185583.145188:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789185583.145710:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789185583.145737:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185583.145751:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272bbea expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185583.145766:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272bbea expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185583.146425:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:11680:x1876096821814144:12345-0@lo:502:llog_process_th.0 Request processed in 4038us (8733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185583.146440:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00010000:2.0:1789185583.251998:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185584.016123:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821814272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185584.016192:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185584.016379:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821814272 00000100:00100000:3.0:1789185584.016385:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821814272 00000100:00100000:3.0:1789185584.016485:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789185584.016495:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821814272:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789185584.016610:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789185584.016746:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185584.016793:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821814272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 301us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185584.016799:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1789185584.016859:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbe680 x1876096821814272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185600 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185584.016874:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821814272:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789185584.146076:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789185584.275021:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185585.295718:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789185586.115850:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1789185586.320197:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185586.824855:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185586.825083:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812342656 00000100:00100000:2.0:1789185586.825108:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812342656 00000100:00100000:2.0:1789185586.825191:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 278 00000100:00100000:2.0:1789185586.825206:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2372:x1876096812342656:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185586.825313:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2372:x1876096812342656:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 110us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185586.825322:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 278 00000100:00100000:2.0:1789185586.826906:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185586.826956:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185586.829587:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812342784 00000100:00100000:0.0:1789185586.829744:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812342784 00000100:00100000:0.0:1789185586.829924:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812343040 00000100:00100000:0.0:1789185586.829929:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812343040 00000100:00100000:2.0:1789185586.830016:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00100000:2.0:1789185586.830032:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2371:x1876096812342784:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185586.830156:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2371:x1876096812342784:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 127us (3258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185586.830164:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00080000:3.0:1789185586.834839:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185586.835168:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185586.835394:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812342912 00000100:00100000:3.0:1789185586.835440:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812342912 00000100:00100000:1.0:1789185586.835709:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:1.0:1789185586.835725:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2372:x1876096812342912:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185586.835849:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2372:x1876096812342912:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 129us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185586.835859:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00080000:2.0:1789185586.836346:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185586.838492:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:0.0:1789185586.838517:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2371:x1876096812343040:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185586.838626:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2371:x1876096812343040:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 120us (11669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185586.838634:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 114 00010000:00010000:2.0:1789185587.343814:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185588.111857:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821814784:0@lo:400:kworker.0 00000100:00100000:3.0:1789185588.111968:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185588.112054:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185588.112061:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821814656:0@lo:400:kworker.0 00000100:00100000:3.0:1789185588.112091:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185588.112134:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821814784 00000100:00100000:3.0:1789185588.112162:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821814784 00000100:00100000:3.0:1789185588.112238:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789185588.112250:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821814784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185588.112313:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821814784:12345-0@lo:400:kworker.0 Request processed in 66us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185588.112320:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789185588.112350:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185588.112365:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821814656 00000100:00100000:3.0:1789185588.112369:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821814656 00000100:00100000:3.0:1789185588.112450:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789185588.112458:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821814656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185588.112492:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821814656:12345-0@lo:400:kworker.0 Request processed in 35us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185588.112499:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1789185588.112518:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185588.112555:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821814656:0@lo:400:kworker.0 00010000:00080000:3.0:1789185588.112569:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbd180 x1876096821814784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185588.112581:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821814784:0@lo:400:kworker.0 00000100:00100000:0.0:1789185588.112831:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821814400:0@lo:400:kworker.0 00000100:00100000:0.0:1789185588.112886:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185588.112927:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821814912:0@lo:400:kworker.0 00000100:00100000:0.0:1789185588.112954:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185588.112975:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789185588.112982:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821814528:0@lo:400:kworker.0 00000100:00100000:0.0:1789185588.113003:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185588.113023:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821815040:0@lo:400:kworker.0 00000100:00100000:0.0:1789185588.113044:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185588.113112:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821814912 00000100:00100000:0.0:1789185588.113117:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821814912 00000100:00100000:0.0:1789185588.113152:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821814528 00000100:00100000:0.0:1789185588.113155:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821814528 00000100:00100000:0.0:1789185588.113176:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789185588.113183:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821814912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185588.113226:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821814912:12345-0@lo:400:kworker.0 Request processed in 43us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185588.113232:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789185588.113246:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789185588.113252:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821814528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185588.113277:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821814528:12345-0@lo:400:kworker.0 Request processed in 26us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185588.113283:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1789185588.113304:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185588.113314:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821815040 00000100:00100000:0.0:1789185588.113318:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821815040 00000100:00100000:0.0:1789185588.113349:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789185588.113355:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821815040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185588.113386:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821815040:12345-0@lo:400:kworker.0 Request processed in 31us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185588.113400:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1789185588.113445:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185588.113469:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821814528:0@lo:400:kworker.0 00000100:00100000:0.0:1789185588.113478:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1789185588.113484:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c793f25fb80, transno 4294967300 00000100:00100000:0.0:1789185588.113495:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821815040:0@lo:400:kworker.0 00000100:00100000:0.0:1789185588.113521:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821814912:0@lo:400:kworker.0 00000100:00100000:2.0:1789185588.113975:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821815168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185588.114023:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185588.114318:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821815168 00000100:00100000:3.0:1789185588.114324:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821815168 00000100:00100000:3.0:1789185588.114399:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789185588.114428:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821815168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185588.114464:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185588.114518:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821815168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185588.114531:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789185588.114633:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821814400 00000100:00100000:1.0:1789185588.114639:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821814400 00000100:00100000:1.0:1789185588.114686:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789185588.114695:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821814400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185588.114746:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821814400:12345-0@lo:400:kworker.0 Request processed in 52us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185588.114752:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789185588.114794:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821814400:0@lo:400:kworker.0 00000100:00100000:1.0:1789185588.114840:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821815168:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789185588.367937:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185589.137107:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185589.137142:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821815296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185589.137257:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.137502:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821815296 00000100:00100000:3.0:1789185589.137514:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821815296 00000100:00100000:3.0:1789185589.137593:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789185589.137607:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821815296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185589.137654:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185589.137727:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821815296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.137737:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1789185589.137819:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbe680 x1876096821815296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185589.137848:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821815296:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789185589.391901:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185590.415753:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185591.445040:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185591.949321:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185591.949380:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185591.949512:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812343168 00000100:00100000:3.0:1789185591.949522:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812343168 00000100:00100000:3.0:1789185591.949584:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 280 00000100:00100000:3.0:1789185591.949595:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812343168:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185591.949677:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812343168:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 84us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185591.949686:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 280 00000100:00100000:0.0:1789185591.949890:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812343424 00000100:00100000:0.0:1789185591.949895:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812343424 00000100:00100000:3.0:1789185591.949990:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185591.950071:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185591.950109:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812343296 00000100:00100000:3.0:1789185591.950114:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812343296 00000100:00100000:2.0:1789185591.950259:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812343552 00000100:00100000:2.0:1789185591.950264:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812343552 00000100:00100000:0.0:1789185591.950908:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:0.0:1789185591.950919:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812343424:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185591.950977:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812343424:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 61us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185591.950983:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00080000:1.0:1789185591.953998:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185591.954390:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185591.955257:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:3.0:1789185591.955268:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812343296:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185591.955551:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812343296:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 285us (5561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185591.955558:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:2.0:1789185591.958217:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:2.0:1789185591.958232:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812343552:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185591.958365:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812343552:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 134us (8292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185591.958373:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 119 00010000:00010000:2.0:1789185592.465562:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185593.231694:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821815424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185593.231857:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185593.231926:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821815936:0@lo:400:kworker.0 00000100:00100000:1.0:1789185593.231931:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821815552:0@lo:400:kworker.0 00000100:00100000:1.0:1789185593.231962:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185593.231966:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185593.231997:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1876096821816064:0@lo:400:kworker.0 00000100:00100000:0.0:1789185593.232001:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821815936 00000100:00100000:0.0:1789185593.232009:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821815936 00000100:00100000:1.0:1789185593.232024:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185593.232058:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821815552 00000100:00100000:1.0:1789185593.232061:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821815552 00000100:00100000:0.0:1789185593.232070:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789185593.232079:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821815936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185593.232085:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789185593.232090:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3279:x1876096821815552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185593.232124:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3279:x1876096821815552:12345-0@lo:400:kworker.0 Request processed in 32us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185593.232124:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821815936:12345-0@lo:400:kworker.0 Request processed in 45us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185593.232132:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789185593.232138:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00010000:00080000:0.0:1789185593.232167:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f128e00 x1876096821815936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185593.232174:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821816064 00000100:00100000:1.0:1789185593.232177:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821816064 00000100:00100000:0.0:1789185593.232180:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821815936:0@lo:400:kworker.0 00000100:00080000:0.0:1789185593.232201:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185593.232202:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1789185593.232205:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185593.232208:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876096821816064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185593.232228:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821815552:0@lo:400:kworker.0 00000100:00100000:1.0:1789185593.232238:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876096821816064:12345-0@lo:400:kworker.0 Request processed in 31us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185593.232244:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789185593.232251:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1876096821816064:0@lo:400:kworker.0 00000100:00100000:0.0:1789185593.232273:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f12b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821815808:0@lo:400:kworker.0 00000100:00100000:0.0:1789185593.232298:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185593.232326:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185593.232331:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821815680:0@lo:400:kworker.0 00000100:00100000:0.0:1789185593.232351:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185593.232369:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821815808 00000100:00100000:1.0:1789185593.232372:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821815808 00000100:00100000:0.0:1789185593.232378:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821815680 00000100:00100000:0.0:1789185593.232381:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821815680 00000100:00100000:0.0:1789185593.232401:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789185593.232441:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821815808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185593.232475:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821815808:12345-0@lo:400:kworker.0 Request processed in 36us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185593.232595:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821815424 00000100:00100000:3.0:1789185593.232600:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821815424 00000100:00100000:3.0:1789185593.232650:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789185593.232658:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821815424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185593.232684:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185593.232722:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821815424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185593.232728:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789185593.235027:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821815424:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789185593.235071:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185593.235077:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185593.235111:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f12b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821815808:0@lo:400:kworker.0 00000100:00100000:1.0:1789185593.235239:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789185593.235257:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821815680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185593.235335:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821815680:12345-0@lo:400:kworker.0 Request processed in 87us (2983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185593.235342:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789185593.235374:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821815680:0@lo:400:kworker.0 00000100:00100000:0.0:1789185593.235930:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00010000:2.0:1789185593.490314:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185594.256240:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821816192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185594.256330:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185594.256567:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821816192 00000100:00100000:2.0:1789185594.256576:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821816192 00000100:00100000:2.0:1789185594.259031:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789185594.259053:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821816192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185594.259095:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185594.259269:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821816192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 226us (2939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185594.259277:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1789185594.260080:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbd880 x1876096821816192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185610 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185594.260104:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821816192:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789185594.384092:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789185594.512461:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185595.536105:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185596.559830:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185597.069666:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185597.069708:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185597.069747:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185597.069778:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185597.069926:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812343808 00000100:00100000:2.0:1789185597.069936:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812343808 00000100:00100000:2.0:1789185597.069999:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812344064 00000100:00100000:2.0:1789185597.070003:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812344064 00000100:00100000:2.0:1789185597.070030:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:2.0:1789185597.070039:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812343808:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185597.070114:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812343808:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 76us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185597.070121:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:2.0:1789185597.070138:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:2.0:1789185597.070161:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812344064:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185597.070188:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812344064:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185597.070194:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:3.0:1789185597.070272:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812343680 00000100:00100000:3.0:1789185597.070276:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812343680 00000100:00100000:3.0:1789185597.070314:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 282 00000100:00100000:3.0:1789185597.070322:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812343680:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185597.070349:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812343680:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 28us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185597.070355:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 282 00000100:00100000:0.0:1789185597.070620:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812343936 00000100:00100000:0.0:1789185597.070625:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812343936 00000100:00100000:0.0:1789185597.070668:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:0.0:1789185597.070676:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2368:x1876096812343936:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:0.0:1789185597.070700:0:6676:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272bb26 00000100:00080000:0.0:1789185597.070709:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9c793f1cb800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789185597.070758:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789185597.071008:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+2:2368:x1876096812343936:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 333us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185597.071015:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00010000:00010000:2.0:1789185597.071193:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789185597.071453:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185597.071458:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789185597.584197:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185598.351755:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821816448:0@lo:400:kworker.0 00000100:00100000:0.0:1789185598.351755:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821816704:0@lo:400:kworker.0 00000100:00100000:1.0:1789185598.351837:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821816320:0@lo:400:kworker.0 00000100:00100000:3.0:1789185598.351903:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821816576:0@lo:400:kworker.0 00000100:00100000:0.0:1789185598.353226:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185598.353316:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821816704 00000100:00100000:0.0:1789185598.353325:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821816704 00000100:00100000:0.0:1789185598.353460:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789185598.353474:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821816704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185598.353532:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821816704:12345-0@lo:400:kworker.0 Request processed in 62us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185598.353539:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1789185598.353585:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7904d5ed80 x1876096821816704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185598.353622:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821816704:0@lo:400:kworker.0 00000100:00080000:0.0:1789185598.353737:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185598.358223:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185598.358294:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821816960:0@lo:400:kworker.0 00000100:00100000:2.0:1789185598.358337:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185598.358491:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821816448 00000100:00100000:0.0:1789185598.358500:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821816448 00000100:00100000:1.0:1789185598.359825:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185598.359892:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821816832:0@lo:400:kworker.0 00000100:00100000:1.0:1789185598.359949:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185598.364339:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821816320 00000100:00100000:1.0:1789185598.364356:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821816320 00000100:00100000:1.0:1789185598.364443:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789185598.364455:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821816320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185598.364533:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821816320:12345-0@lo:400:kworker.0 Request processed in 81us (4712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185598.364540:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789185598.364594:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821816320:0@lo:400:kworker.0 00000100:00100000:2.0:1789185598.365278:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821816960 00000100:00100000:2.0:1789185598.365287:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821816960 00000100:00100000:2.0:1789185598.365352:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789185598.365361:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821816960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185598.365639:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821816960:12345-0@lo:400:kworker.0 Request processed in 279us (7301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185598.365648:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789185598.365690:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821816960:0@lo:400:kworker.0 00000100:00100000:3.0:1789185598.365842:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185598.369288:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821816832 00000100:00100000:0.0:1789185598.369305:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821816832 00000100:00080000:0.0:1789185598.369327:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185598.369362:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185598.370803:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789185598.370829:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821816448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185598.370951:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821816448:12345-0@lo:400:kworker.0 Request processed in 132us (12732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185598.370962:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789185598.371042:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789185598.371088:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821816832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185598.372097:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821816832:12345-0@lo:400:kworker.0 Request processed in 1042us (12140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185598.372108:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789185598.373114:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821816448:0@lo:400:kworker.0 00000100:00100000:0.0:1789185598.373191:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821816832:0@lo:400:kworker.0 00000100:00100000:3.0:1789185598.373307:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821817088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185598.373357:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185598.373470:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821816576 00000100:00100000:1.0:1789185598.373478:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821816576 00000100:00100000:1.0:1789185598.373530:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789185598.373539:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821816576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185598.373591:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821816576:12345-0@lo:400:kworker.0 Request processed in 53us (7750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185598.373598:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789185598.373610:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821816576:0@lo:400:kworker.0 00000100:00100000:2.0:1789185598.373648:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821817088 00000100:00100000:2.0:1789185598.373652:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821817088 00000100:00100000:2.0:1789185598.373688:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789185598.373696:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821817088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789185598.373726:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185598.373821:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821817088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185598.373845:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789185598.373904:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821817088:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789185598.374237:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789185598.609144:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185599.375697:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185599.375723:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821817216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185599.375808:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185599.376058:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821817216 00000100:00100000:3.0:1789185599.376081:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821817216 00000100:00100000:3.0:1789185599.376134:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789185599.376144:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821817216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185599.376201:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185599.376261:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821817216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185599.376269:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1789185599.376462:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbea00 x1876096821817216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185599.376480:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821817216:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789185599.631703:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185600.655633:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789185601.481563:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000020:00000080:3.0:1789185601.481574:0:7633:0:(genops.c:885:class_export_put()) final put ffff9c793f1cd000/19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000020:00000080:1.0:1789185601.481766:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c793f1cd000/19bfb1a3-97ed-41fd-ac10-946cffd5be7d for lustre-OST0001 00000020:00000080:1.0:1789185601.481828:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c793f1cb800 for lustre-OST0001 00010000:00010000:0.0:1789185601.680019:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185602.190624:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185602.190689:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185602.190722:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185602.190768:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812344448 00000100:00100000:1.0:1789185602.190778:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812344448 00000100:00100000:1.0:1789185602.190830:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812344320 00000100:00100000:1.0:1789185602.190833:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812344320 00000100:00100000:1.0:1789185602.190854:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 128 00000100:00100000:1.0:1789185602.190863:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812344448:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185602.190940:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812344448:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 78us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185602.190948:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 128 00000100:00100000:1.0:1789185602.190965:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 129 00000100:00100000:1.0:1789185602.190972:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812344320:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185602.190999:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812344320:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 27us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185602.191005:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 129 00000100:00080000:0.0:1789185602.191208:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185602.191831:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812344192 00000100:00100000:2.0:1789185602.191838:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812344192 00000100:00100000:2.0:1789185602.191872:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 284 00000100:00100000:2.0:1789185602.191878:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2369:x1876096812344192:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185602.193306:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2369:x1876096812344192:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 1420us (2686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185602.193318:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 284 00010000:00010000:2.0:1789185602.707780:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185603.475102:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185603.475125:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821817344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185603.475200:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185603.475259:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821817344 00000100:00100000:2.0:1789185603.475266:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821817344 00000100:00100000:2.0:1789185603.475315:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789185603.475323:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821817344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789185603.475359:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185603.475427:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821817344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185603.475435:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1789185603.475455:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185603.475486:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821817344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185603.476904:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821817856:0@lo:400:kworker.0 00000100:00100000:1.0:1789185603.476958:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185603.476990:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185603.476996:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821817728:0@lo:400:kworker.0 00000100:00100000:1.0:1789185603.477020:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185603.477048:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821817856 00000100:00100000:1.0:1789185603.477054:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821817856 00000100:00100000:1.0:1789185603.477101:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789185603.477110:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821817856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185603.477152:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821817856:12345-0@lo:400:kworker.0 Request processed in 44us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185603.477171:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789185603.477194:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821817728 00000100:00100000:1.0:1789185603.477198:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821817728 00000100:00100000:1.0:1789185603.477223:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789185603.477228:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821817728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185603.477256:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821817728:12345-0@lo:400:kworker.0 Request processed in 28us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185603.477262:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789185603.477295:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821817728:0@lo:400:kworker.0 00010000:00080000:1.0:1789185603.477306:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dc0380 x1876096821817856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185603.478308:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821817856:0@lo:400:kworker.0 00000100:00100000:0.0:1789185603.478439:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821817472:0@lo:400:kworker.0 00000100:00100000:0.0:1789185603.478494:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185603.478568:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821817984:0@lo:400:kworker.0 00000100:00100000:0.0:1789185603.478592:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185603.478610:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185603.478616:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821817600:0@lo:400:kworker.0 00000100:00100000:0.0:1789185603.478635:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185603.478747:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821817984 00000100:00100000:0.0:1789185603.478753:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821817984 00000100:00100000:0.0:1789185603.478786:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821817600 00000100:00100000:0.0:1789185603.478788:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821817600 00000100:00100000:0.0:1789185603.478806:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789185603.478813:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821817984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185603.478855:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821817984:12345-0@lo:400:kworker.0 Request processed in 42us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185603.478861:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789185603.478879:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789185603.478885:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821817600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185603.478908:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821817600:12345-0@lo:400:kworker.0 Request processed in 25us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185603.478913:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789185603.478944:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821817600:0@lo:400:kworker.0 00000100:00100000:0.0:1789185603.478953:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821817984:0@lo:400:kworker.0 00000100:00080000:2.0:1789185603.479029:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789185603.479042:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185603.479105:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821817472 00000100:00100000:1.0:1789185603.479109:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821817472 00000100:00100000:1.0:1789185603.479145:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789185603.479152:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821817472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185603.479190:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821817472:12345-0@lo:400:kworker.0 Request processed in 38us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185603.479195:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789185603.479226:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821817472:0@lo:400:kworker.0 00010000:00010000:2.0:1789185603.727632:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185604.505233:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185604.505256:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821818112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185604.505340:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185604.505436:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821818112 00000100:00100000:3.0:1789185604.505446:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821818112 00000100:00100000:3.0:1789185604.505495:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789185604.505504:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821818112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185604.505538:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185604.505583:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821818112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185604.505590:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1789185604.505630:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7936dbea00 x1876096821818112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185604.505648:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821818112:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789185604.626191:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789185604.754960:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789185604.841197:0:11846:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:00:02 (1789185602) 00010000:00010000:2.0:1789185605.776158:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185606.416043:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185606.416266:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812344576 00000100:00100000:0.0:1789185606.416276:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812344576 00000100:00100000:0.0:1789185606.416365:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:0.0:1789185606.416376:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:10256:x1876096812344576:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185606.416455:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185606.416508:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272bbf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d4c6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185606.416587:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bbf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185606.416603:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185606.416619:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185606.416657:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789185606.416661:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185606.416714:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185606.416739:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272bbf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4c6 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185606.416758:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4c6 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185606.416765:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79117a4c00) 00010000:00010000:0.0:1789185606.416768:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185606.416772:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355200, rc 0) 00000100:00100000:0.0:1789185606.416829:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:10256:x1876096812344576:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 455us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185606.416836:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00080000:3.0:1789185606.417340:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185606.439651:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185606.439803:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812344704 00000100:00100000:1.0:1789185606.439818:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812344704 00000100:00100000:1.0:1789185606.439887:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:1.0:1789185606.439898:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:10257:x1876096812344704:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185606.439922:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185606.439944:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bbff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d4cd expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440023:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bc06 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440039:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bc06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440051:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bc06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440066:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bc0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440073:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bc0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440079:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bc0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440331:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4cc00/0x532743011272bc14 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440341:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4cc00/0x532743011272bc14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440347:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4cc00/0x532743011272bc14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185606.440390:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789185606.440395:0:5822:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789185606.440482:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4cc00/0x532743011272bc14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440495:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bc06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440502:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bc06 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440510:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bc06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440517:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185606.440522:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bc06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440531:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bc06 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440544:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79117a4c00) 00010000:00010000:1.0:1789185606.440547:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185606.440553:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bc06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440560:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bc06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440575:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bc0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440591:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bc0d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440597:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bc0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440601:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4ce00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185606.440604:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bc0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440610:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bc0d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440619:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c791aedc300) 00010000:00010000:1.0:1789185606.440621:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185606.440624:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bc0d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440629:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bc0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440664:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bbff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4cd expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440679:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4cc00/0x532743011272bc14 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4cd expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185606.440687:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c791aedc500) 00010000:00010000:1.0:1789185606.440689:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789185606.440713:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4cc00, rc 0) 00000100:00100000:1.0:1789185606.440792:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:10257:x1876096812344704:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 895us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185606.440799:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:0.0:1789185606.445131:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185606.445246:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812344960 00000100:00100000:2.0:1789185606.445257:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812344960 00000100:00100000:2.0:1789185606.445324:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:2.0:1789185606.445334:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:10257:x1876096812344960:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185606.445356:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185606.445380:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bc1b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d4d4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.445507:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc22 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.445523:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc22 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.445535:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc22 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.445551:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc29 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.445558:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.445565:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.445923:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272bc30 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.445939:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272bc30 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.445945:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272bc30 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185606.445955:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789185606.446105:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc22 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446113:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc22 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446120:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc22 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446126:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185606.446130:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc22 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446137:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc22 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446150:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c791aedc500) 00010000:00010000:2.0:1789185606.446153:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185606.446158:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc22 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446165:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc22 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446176:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446187:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc29 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446192:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc29 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446197:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185606.446199:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc29 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446205:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc29 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446212:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c792334ab00) 00010000:00010000:2.0:1789185606.446214:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185606.446217:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc29 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446223:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc29 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446810:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bc1b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4d4 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446829:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272bc30 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4d4 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185606.446837:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c792334af00) 00010000:00010000:2.0:1789185606.446840:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185606.446849:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6600, rc 0) 00000100:00100000:2.0:1789185606.446912:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:10257:x1876096812344960:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1578us (1794us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789185606.446921:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:3.0:1789185606.451319:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185606.451854:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812345088 00000100:00100000:0.0:1789185606.451873:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812345088 00000100:00100000:0.0:1789185606.451970:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:0.0:1789185606.451983:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:10257:x1876096812345088:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789185606.452115:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:10257:x1876096812345088:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 Request processed in 135us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185606.452122:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000001:00080000:0.0:1789185606.575876:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000040:00080000:2.0:1789185606.672031:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789185606.800657:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185607.314817:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185607.314869:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185607.314906:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185607.314936:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812345472 00000100:00100000:1.0:1789185607.314947:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812345472 00000100:00100000:1.0:1789185607.315006:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812345344 00000100:00100000:1.0:1789185607.315009:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812345344 00000100:00100000:1.0:1789185607.315044:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 133 00000100:00100000:1.0:1789185607.315055:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812345472:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185607.315151:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812345472:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 97us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185607.315158:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 133 00000100:00100000:1.0:1789185607.315180:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 134 00000100:00100000:1.0:1789185607.315200:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2370:x1876096812345344:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185607.315232:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2370:x1876096812345344:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 44us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185607.315238:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 134 00000100:00100000:0.0:1789185607.315593:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812345216 00000100:00100000:0.0:1789185607.315599:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812345216 00000100:00100000:0.0:1789185607.315633:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 286 00000100:00100000:0.0:1789185607.315640:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812345216:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185607.315679:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812345216:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 39us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185607.315685:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 286 00000100:00080000:3.0:1789185607.315814:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789185607.833071:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185608.518769:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185608.519006:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812345600 00000100:00100000:0.0:1789185608.519020:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812345600 00000100:00100000:0.0:1789185608.519119:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:0.0:1789185608.519132:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:10300:x1876096812345600:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789185608.519161:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185608.519189:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272bc3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d4db expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.519274:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272bc45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.519295:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272bc45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.519322:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272bc45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.519351:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272bc4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.519359:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272bc4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.519366:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272bc4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.519928:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272bc45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.519939:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272bc45 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.519946:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272bc45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.519953:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185608.519958:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272bc45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.519968:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272bc45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.519984:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79117a4c00) 00010000:00010000:0.0:1789185608.519993:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185608.520001:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272bc45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.520007:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272bc45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.520019:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272bc4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.520025:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272bc4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.520032:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272bc4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.520037:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185608.520040:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272bc4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.520046:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272bc4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.520053:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c79117a4800) 00010000:00010000:0.0:1789185608.520056:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185608.520059:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272bc4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.520065:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272bc4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.520111:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272bc3e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4db expref: 9 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.520129:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79117a4c00) 00010000:00010000:0.0:1789185608.520131:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185608.520136:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272bc3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4db expref: 9 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.520146:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354600, rc 0) 00000100:00100000:0.0:1789185608.520256:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:10300:x1876096812345600:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1125us (1501us total) trans 0 rc 301/301 00000100:00100000:0.0:1789185608.520266:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00080000:2.0:1789185608.520386:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185608.526637:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185608.526846:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812345856 00000100:00100000:2.0:1789185608.526862:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812345856 00000100:00100000:2.0:1789185608.526981:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:2.0:1789185608.526995:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:10300:x1876096812345856:12345-192.168.202.54@tcp:36:lfs.0 00010000:00010000:2.0:1789185608.527081:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185608.527118:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bbf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4c6 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.527140:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79117a4c00) 00010000:00010000:2.0:1789185608.527157:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185608.527540:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc53 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.527840:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.527857:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.527874:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc5a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.527883:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.527902:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185608.530049:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789185608.530076:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.530089:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc53 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.530098:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc53 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.530105:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185608.530112:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc53 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.530121:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc53 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.530143:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334a900) 00010000:00010000:2.0:1789185608.530147:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185608.530153:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc53 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.530160:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bc53 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185608.530186:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d3e77377 reply state 00000000fc1a8284 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185608.532768:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185608.532970:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:10300:x1876096812345856:12345-192.168.202.54@tcp:36:lfs.0 Request processed in 5970us (6339us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789185608.534610:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00010000:00010000:3.0:1789185608.536612:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.536655:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc5a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.536664:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc5a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.536671:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185608.536688:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc5a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.536698:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc5a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.536717:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c792334a500) 00010000:00010000:3.0:1789185608.536721:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185608.536727:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc5a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.536734:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bc5a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185608.593401:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821818368:0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.593517:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.593588:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821818880:0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.593616:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.593664:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789185608.593670:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821818240:0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.593713:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.593734:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821818752:0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.593755:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.593783:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821818496:0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.593805:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.593822:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185608.593828:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821818624:0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.593847:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.593884:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821818368 00000100:00100000:1.0:1789185608.593894:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821818368 00000100:00100000:1.0:1789185608.593947:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821818752 00000100:00100000:1.0:1789185608.593950:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821818752 00000100:00100000:1.0:1789185608.593980:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821818496 00000100:00100000:1.0:1789185608.593983:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821818496 00000100:00100000:1.0:1789185608.594002:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789185608.594011:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821818368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.594076:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821818368:12345-0@lo:400:kworker.0 Request processed in 65us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.594084:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789185608.594105:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789185608.594110:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821818752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.594134:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821818752:12345-0@lo:400:kworker.0 Request processed in 24us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.594140:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789185608.594149:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789185608.594161:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821818496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.594190:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821818496:12345-0@lo:400:kworker.0 Request processed in 29us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.594196:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789185608.594215:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821818880 00000100:00100000:1.0:1789185608.594218:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821818880 00000100:00100000:1.0:1789185608.594243:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821818624 00000100:00100000:1.0:1789185608.594246:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821818624 00000100:00100000:1.0:1789185608.594263:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789185608.594270:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821818880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.594297:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821818880:12345-0@lo:400:kworker.0 Request processed in 28us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.594303:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789185608.594313:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789185608.594318:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821818624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.594340:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821818624:12345-0@lo:400:kworker.0 Request processed in 23us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.594346:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1789185608.594369:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185608.594374:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185608.594377:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789185608.594439:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c780247f480 x1876096821818624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185608.594456:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821818624:0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.594469:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821818496:0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.594500:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821818752:0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.594516:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821818368:0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.594524:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821818880:0@lo:400:kworker.0 00000100:00100000:0.0:1789185608.594779:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821818240 00000100:00100000:0.0:1789185608.594786:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821818240 00000100:00100000:0.0:1789185608.594830:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789185608.594838:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821818240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185608.594888:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821818240:12345-0@lo:400:kworker.0 Request processed in 51us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.594895:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789185608.594943:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821818240:0@lo:400:kworker.0 00000100:00100000:1.0:1789185608.596558:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789185608.596585:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821819008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185608.596688:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185608.596837:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821819008 00000100:00100000:3.0:1789185608.596846:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821819008 00000100:00100000:3.0:1789185608.596913:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789185608.596926:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821819008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185608.596972:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185608.597039:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821819008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185608.597049:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789185608.597367:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821819008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185608.604114:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185608.604341:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812345984 00000100:00100000:1.0:1789185608.604356:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812345984 00000100:00100000:1.0:1789185608.604445:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:1.0:1789185608.604459:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:10308:x1876096812345984:12345-192.168.202.54@tcp:101:lctl.0 00010000:00010000:1.0:1789185608.604502:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185608.604531:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272bc61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d4e2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.604624:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272bc68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.604641:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272bc68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.604655:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272bc68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185608.604709:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789185608.604713:0:5822:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789185608.604766:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272bc68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.604813:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272bc61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4e2 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.604831:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272bc68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4e2 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.604842:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:1.0:1789185608.604845:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789185608.604849:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4c800, rc 0) 00000100:00100000:1.0:1789185608.604929:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:10308:x1876096812345984:12345-192.168.202.54@tcp:101:lctl.0 Request processed in 473us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.604937:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:2.0:1789185608.657977:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185608.660299:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812346112 00000100:00100000:3.0:1789185608.660323:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812346112 00000100:00100000:3.0:1789185608.660446:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:3.0:1789185608.660460:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:10314:x1876096812346112:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1789185608.660566:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185608.660731:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bc6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d4e9 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.660827:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bc76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.660847:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bc76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.660863:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bc76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.660881:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bc7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.660888:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bc7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.660894:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bc7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.661021:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04a00/0x532743011272bc84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.661030:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04a00/0x532743011272bc84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.661048:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04a00/0x532743011272bc84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185608.661088:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789185608.661093:0:11024:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789185608.661145:0:11024:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04a00/0x532743011272bc84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.661161:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bc76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.661169:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bc76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.661177:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bc76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.661184:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185608.663301:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bc76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.663331:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bc76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.663357:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:3.0:1789185608.663360:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185608.663367:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bc76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.663377:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bc76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.663432:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bc7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.663440:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bc7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.663448:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bc7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.663454:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185608.663457:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bc7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.663464:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bc7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.664174:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c79055dd700) 00010000:00010000:3.0:1789185608.664178:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185608.664183:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bc7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.664715:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bc7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.664795:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bc6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4e9 expref: 11 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.664814:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04a00/0x532743011272bc84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4e9 expref: 10 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.664842:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:3.0:1789185608.664844:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789185608.664847:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04a00, rc 0) 00000100:00100000:3.0:1789185608.664949:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+10:10314:x1876096812346112:12345-192.168.202.54@tcp:101:bash.0 Request processed in 4491us (6985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185608.664959:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:3.0:1789185608.671190:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185608.673179:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812346368 00000100:00100000:1.0:1789185608.673212:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812346368 00000100:00100000:1.0:1789185608.673292:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:1.0:1789185608.673305:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+10:10314:x1876096812346368:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789185608.673334:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185608.673363:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272bc8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d4f0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.674319:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bc92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.674345:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bc92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.674363:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bc92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.683858:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272bc99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.683890:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272bc99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.683903:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272bc99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789185608.686441:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789185608.686981:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bca0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.687003:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.687019:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.687068:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bc92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.687076:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bc92 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.687085:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bc92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.687092:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185608.687098:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bc92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.687130:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bc92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.687146:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:1.0:1789185608.687150:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185608.687158:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bc92 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.687166:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272bc92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185608.687184:0:5822:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f8517e58 reply state 00000000e45481ec transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272bc99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185608.687209:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789185608.687260:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272bc8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f0 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.687277:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f0 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.687286:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c791aedc200) 00010000:00010000:1.0:1789185608.687288:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185608.687291:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4c000, rc 0) 00000100:00100000:1.0:1789185608.687494:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:10314:x1876096812346368:12345-192.168.202.54@tcp:101:bash.0 Request processed in 14191us (16319us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789185608.687504:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 40 00010000:00010000:3.0:1789185608.693161:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272bc99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.693185:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272bc99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.693258:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272bc99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.693265:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4ca00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185608.693272:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272bc99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.693282:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272bc99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.693303:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c791aedc400) 00010000:00010000:3.0:1789185608.693307:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185608.693313:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272bc99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.693318:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272bc99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185608.696008:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185608.696663:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812346496 00000100:00100000:1.0:1789185608.696695:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812346496 00000100:00100000:1.0:1789185608.696765:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:1.0:1789185608.696776:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2368:x1876096812346496:12345-192.168.202.54@tcp:8:bash.0 00010000:00080000:1.0:1789185608.696817:0:6679:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp t0 exp 0000000000000000 cur 305 last 0 00000020:00000080:1.0:1789185608.696861:0:6679:0:(genops.c:1384:class_connect()) connect: client 19bfb1a3-97ed-41fd-ac10-946cffd5be7d, cookie 0x532743011272bcae 00002000:00100000:1.0:1789185608.696877:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 19bfb1a3-97ed-41fd-ac10-946cffd5be7d/ffff9c792fae3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789185608.696908:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:1.0:1789185608.697207:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789185608.697252:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9c791a5a7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185608.697355:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2368:x1876096812346496:12345-192.168.202.54@tcp:8:bash.0 Request processed in 579us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.697364:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:0.0:1789185608.710767:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185608.710880:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812346624 00000100:00100000:1.0:1789185608.710893:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812346624 00000100:00100000:1.0:1789185608.711006:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:1.0:1789185608.711018:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:0:x1876096812346624:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789185608.711041:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185608.711072:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272bcb5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d4f7 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789185608.711108:0:6884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185608.711134:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=305s v=(0 0) 00010000:00010000:1.0:1789185608.711140:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185608.711152:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272bcb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f7 expref: 7 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.711215:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272bcb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f7 expref: 7 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.711232:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4c200, rc 0) 00000100:00100000:1.0:1789185608.711313:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:0:x1876096812346624:12345-192.168.202.54@tcp:101:bash.0 Request processed in 296us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.711321:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00080000:3.0:1789185608.711582:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185608.718493:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185608.718803:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812346752 00000100:00100000:1.0:1789185608.718816:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812346752 00000100:00100000:1.0:1789185608.718897:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:1.0:1789185608.718910:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:10314:x1876096812346752:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789185608.718934:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185608.718959:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d4fe expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.719004:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272bcb5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f7 expref: 8 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.719016:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185608.719021:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185608.719028:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.719075:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272bcb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f7 expref: 8 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.719114:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272bcb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f7 expref: 8 pid: 6884 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185608.719132:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1876096821819136:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789185608.721924:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7929b2d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789185608.726238:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185608.726367:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1876096821819136:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185608.726556:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812346880 00000100:00100000:3.0:1789185608.726567:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812346880 00010000:00010000:3.0:1789185608.726622:0:6692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272bcb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f7 expref: 9 pid: 6884 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185608.726684:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:3.0:1789185608.726697:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2372:x1876096812346880:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185608.726717:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185608.726750:0:6692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272bcb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f7 expref: 9 pid: 6884 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.726769:0:6692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272bcb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f7 expref: 9 pid: 6884 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.726804:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272bcb5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f7 expref: 9 pid: 6884 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.726828:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185608.726833:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185608.726843:0:6692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.726854:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.726924:0:6692:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185608.726942:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6692:1876096821819264:192.168.202.54@tcp:105: 00000100:00100000:3.0:1789185608.727056:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79103c13c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789185608.728894:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.728952:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4de00, rc 0) 00000100:00100000:0.0:1789185608.729046:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:10314:x1876096812346752:12345-192.168.202.54@tcp:101:bash.0 Request processed in 10137us (10577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.729057:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:3.0:1789185608.730068:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6692:1876096821819264:192.168.202.54@tcp:105: 00010000:00010000:3.0:1789185608.730102:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185608.730157:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2372:x1876096812346880:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3461us (3939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185608.730169:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:3.0:1789185608.739519:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185608.740700:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812347136 00000100:00100000:0.0:1789185608.740718:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812347136 00000100:00100000:0.0:1789185608.740816:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:0.0:1789185608.740830:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:10314:x1876096812347136:12345-192.168.202.54@tcp:35:bash.0 00000001:00080000:1.0:1789185608.743970:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:1.0:1789185608.744266:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:10314:x1876096812347136:12345-192.168.202.54@tcp:35:bash.0 Request processed in 3433us (4754us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789185608.744287:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000020:00080000:1.0:1789185608.744295:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789185608.846947:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185608.847193:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812347392 00000100:00100000:2.0:1789185608.847207:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812347392 00000100:00100000:2.0:1789185608.847286:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:2.0:1789185608.847298:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:10324:x1876096812347392:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185608.847348:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185608.847375:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bcc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d505 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185608.847548:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789185608.847733:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bcc3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d505 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.847751:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:2.0:1789185608.847755:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185608.847761:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bcc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d505 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.847779:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6200, rc 0) 00000100:00100000:2.0:1789185608.847856:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:10324:x1876096812347392:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 559us (923us total) trans 4294967314 rc 301/301 00000100:00100000:2.0:1789185608.847864:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 41 00010000:00010000:2.0:1789185608.848631:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185608.855024:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185608.855506:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812347648 00000100:00100000:2.0:1789185608.855520:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812347648 00000100:00100000:2.0:1789185608.855770:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:2.0:1789185608.855784:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:10324:x1876096812347648:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789185608.856123:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:10324:x1876096812347648:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 340us (1111us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789185608.856132:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1789185608.938501:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185608.938686:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812347776 00000100:00100000:1.0:1789185608.938701:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812347776 00000100:00100000:1.0:1789185608.938793:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:1.0:1789185608.938807:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:10330:x1876096812347776:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789185608.938842:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185608.938871:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272bcd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d50c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.938971:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272bcd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.938989:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272bcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.939004:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272bcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185608.939074:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789185608.939078:0:5822:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789185608.939109:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272bcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.939146:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272bcd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d50c expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.939170:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272bcd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d50c expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.939180:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:1.0:1789185608.939182:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789185608.939187:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4d400, rc 0) 00000100:00100000:1.0:1789185608.939271:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+17:10330:x1876096812347776:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 466us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.939278:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:0.0:1789185608.950930:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185608.951075:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812348032 00000100:00100000:2.0:1789185608.951089:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812348032 00000100:00100000:2.0:1789185608.951175:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:2.0:1789185608.951188:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+17:10330:x1876096812348032:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185608.951229:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185608.951260:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bcdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d513 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.951484:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bce6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.951504:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bce6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.951519:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bce6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185608.951534:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789185608.951760:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bcdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d513 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.951810:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bce6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d513 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.951819:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c791aedc200) 00010000:00010000:2.0:1789185608.951823:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185608.951827:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7600, rc 0) 00000100:00100000:2.0:1789185608.951903:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:10330:x1876096812348032:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 718us (991us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789185608.951912:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:3.0:1789185608.956273:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185608.956347:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812348288 00000100:00100000:1.0:1789185608.956360:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812348288 00000100:00100000:1.0:1789185608.956588:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:1.0:1789185608.956601:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:10330:x1876096812348288:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789185608.956634:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185608.956693:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272bcf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d51a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.956866:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bcfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.956896:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bcfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.956911:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bcfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185608.956929:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789185608.957102:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272bcf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d51a expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.957126:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bcfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d51a expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.957136:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c791aedc200) 00010000:00010000:1.0:1789185608.957140:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789185608.957143:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4c400, rc 0) 00000100:00100000:1.0:1789185608.957226:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:10330:x1876096812348288:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 626us (965us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789185608.957234:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:0.0:1789185608.962839:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185608.962943:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812348416 00000100:00100000:3.0:1789185608.962958:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812348416 00000100:00100000:3.0:1789185608.963057:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:3.0:1789185608.963070:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:2371:x1876096812348416:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185608.963090:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185608.963126:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bce6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d513 expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.963151:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c791aedc200) 00010000:00010000:3.0:1789185608.963157:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185608.963232:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:2371:x1876096812348416:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 164us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185608.963258:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:0.0:1789185608.966627:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185608.968261:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812348544 00000100:00100000:1.0:1789185608.968559:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812348544 00000100:00100000:0.0:1789185608.972239:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:0.0:1789185608.972258:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2372:x1876096812348544:12345-192.168.202.54@tcp:1:lfs.0 00010000:00010000:0.0:1789185608.972436:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8784886/0x532743011272bd09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.972464:0:6884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.972477:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789185608.972482:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789185608.972487:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8784886/0x532743011272bd09 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.972585:0:6884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.972813:0:6884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 7 pid: 6679 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185608.972842:0:6884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6884:1876096821819392:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789185608.972983:0:6884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c792f6a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.980578:0:6884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6884:1876096821819392:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185608.980625:0:6884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e8784886/0x532743011272bd09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185608.984772:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185608.984900:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812348672 00000100:00100000:2.0:1789185608.984920:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812348672 00002000:00100000:2.0:1789185608.984996:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9c7936b5f480 x1876096812348672/t0(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:209/0 lens 504/0 e 0 to 0 dl 1789185619 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185608.985012:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7936b5f480 with x1876096812348672 ext(0->12) 00010000:00010000:2.0:1789185608.985024:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 8 pid: 6679 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.985060:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 8 pid: 6679 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789185608.985070:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c7936b5f480 00000100:00100000:2.0:1789185608.986576:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:2.0:1789185608.986605:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2372:x1876096812348672:12345-192.168.202.54@tcp:4:lfs.0 00000001:00100000:0.0:1789185609.078213:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000100:00100000:3.0:1789185609.079447:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2372:x1876096812348672:12345-192.168.202.54@tcp:4:lfs.0 Request processed in 92846us (94675us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789185609.079471:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00002000:00100000:3.0:1789185609.079488:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9c7936b5f480 x1876096812348672/t4294967299(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:209/0 lens 504/448 e 0 to 0 dl 1789185619 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789185609.079499:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7936b5f480 with x1876096812348672 ext(0->12) 00010000:00010000:3.0:1789185609.079513:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 9 pid: 6679 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.079541:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 9 pid: 6679 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789185609.079550:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c7936b5f480 00000100:00100000:1.0:1789185609.083732:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185609.083862:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812348800 00000100:00100000:2.0:1789185609.083894:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812348800 00010000:00010000:2.0:1789185609.083947:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 9 pid: 6679 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185609.084038:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:2.0:1789185609.084051:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2371:x1876096812348800:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185609.084070:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789185609.084099:0:5809:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789185609.084102:0:5809:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789185608 00002000:00010000:2.0:1789185609.084105:0:5809:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789185608 00002000:00010000:2.0:1789185609.084107:0:5809:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789185608 00010000:00010000:2.0:1789185609.084114:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 9 pid: 6679 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.084133:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 9 pid: 6679 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.084172:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050643711/0x532743011272bcbc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4fe expref: 9 pid: 6679 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.084196:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185609.084202:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185609.084210:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8784886/0x532743011272bd09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.084223:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8784886/0x532743011272bd09 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.084275:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185609.084521:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2371:x1876096812348800:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 471us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.084531:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00010000:00010000:0.0:1789185609.084621:0:6884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e8784886/0x532743011272bd09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.084633:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8784886/0x532743011272bd09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.084667:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8784886/0x532743011272bd09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.084693:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8784886/0x532743011272bd09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.084719:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8784886/0x532743011272bd09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.084727:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355200 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185609.084732:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8784886/0x532743011272bd09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.084743:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8784886/0x532743011272bd09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.084760:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8784886/0x532743011272bd09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.084768:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8784886/0x532743011272bd09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185609.084827:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2372:x1876096812348544:12345-192.168.202.54@tcp:1:lfs.0 Request processed in 112574us (118213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185609.084835:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1789185609.090144:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185609.090253:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812349056 00000100:00100000:3.0:1789185609.090266:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812349056 00000100:00100000:3.0:1789185609.091043:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:3.0:1789185609.091060:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:10330:x1876096812349056:12345-192.168.202.54@tcp:35:lfs.0 00000004:00010000:3.0:1789185609.091148:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bcfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d51a expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789185609.091877:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1789185609.091937:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1789185609.092932:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:3.0:1789185609.093033:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.093056:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bca0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f0 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.093065:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd10 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.093116:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f0 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.093139:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bca0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f0 expref: 24 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185609.093157:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1876096821819520:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185609.094072:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79103c13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185609.098085:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185609.098661:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1876096821819520:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185609.098713:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185609.098904:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812349184 00000100:00100000:3.0:1789185609.098914:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812349184 00010000:00010000:3.0:1789185609.098957:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bca0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f0 expref: 25 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185609.099703:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:3.0:1789185609.099719:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+25:2371:x1876096812349184:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185609.099740:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185609.099750:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bca0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f0 expref: 25 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.099768:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f0 expref: 25 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.099816:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bca0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4f0 expref: 25 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.099834:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c791aedc200) 00010000:00010000:3.0:1789185609.099841:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.099852:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.099860:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd10 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.099935:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185609.100007:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+24:2371:x1876096812349184:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 292us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185609.100016:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00010000:00010000:2.0:1789185609.100123:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.100132:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185609.100317:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:2.0:1789185609.101002:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1789185609.101180:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876096821819648:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789185609.105571:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185609.105625:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79192ea000 going to sleep for 11 seconds 00000100:00100000:0.0:1789185609.105660:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821819648 00000100:00100000:0.0:1789185609.105689:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821819648 00000100:00100000:0.0:1789185609.105824:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185609.105836:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1876096821819648:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789185609.106004:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1876096821819648:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 171us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185609.106013:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185609.106106:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876096821819648:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789185609.107022:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1789185609.107149:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876096821819776:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789185609.107242:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185609.107971:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79192eab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185609.108010:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821819776 00000100:00100000:3.0:1789185609.108020:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821819776 00000100:00100000:1.0:1789185609.108189:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789185609.108201:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1876096821819776:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789185609.108777:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5826:x1876096821819776:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 574us (1531us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789185609.108798:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789185609.109231:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876096821819776:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789185609.109575:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789185609.109643:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.109654:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd10 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.109681:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.109688:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185609.109694:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.109703:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd10 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.109724:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c791aedc200) 00010000:00010000:2.0:1789185609.109727:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789185609.109733:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd10 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.109740:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd10 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789185609.109993:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789185609.110262:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789185609.110278:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 306149871615ns, next at 307149868069ns, rc = 0 00000001:00080000:2.0:1789185609.110286:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1789185609.110579:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c791aedc200) 00010000:00010000:2.0:1789185609.110583:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789185609.110592:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bcfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d51a expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185609.110793:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+27:10330:x1876096812349056:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 19737us (20663us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789185609.110817:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000020:00080000:2.0:1789185609.110824:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789185609.113929:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185609.114025:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812349312 00000100:00100000:2.0:1789185609.114039:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812349312 00000100:00100000:2.0:1789185609.114113:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:2.0:1789185609.114125:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+27:10330:x1876096812349312:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185609.114158:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185609.114191:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bd17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d521 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.114272:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bd17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d521 expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.114291:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bd17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d521 expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.114325:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:2.0:1789185609.114329:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185609.114340:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6200, rc 0) 00000100:00100000:2.0:1789185609.114457:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+28:10330:x1876096812349312:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 334us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.114465:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:1.0:1789185609.118154:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185609.118247:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812349568 00000100:00100000:2.0:1789185609.118260:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812349568 00000100:00100000:2.0:1789185609.118352:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:2.0:1789185609.118365:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791916f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+28:10330:x1876096812349568:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789185609.118785:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791916f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+29:10330:x1876096812349568:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 422us (644us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789185609.118797:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:0.0:1789185609.213227:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185609.213822:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812349824 00000100:00100000:2.0:1789185609.213838:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812349824 00000100:00100000:2.0:1789185609.213974:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:2.0:1789185609.213988:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+29:10340:x1876096812349824:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185609.214023:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185609.214265:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bd1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d528 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185609.214550:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789185609.215032:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bd1e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d528 expref: 31 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.215123:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:3.0:1789185609.215127:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185609.215152:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bd1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d528 expref: 31 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.215174:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7600, rc 0) 00000100:00100000:3.0:1789185609.215283:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+30:10340:x1876096812349824:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1296us (2068us total) trans 4294967328 rc 301/301 00000100:00100000:3.0:1789185609.215294:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:0.0:1789185609.220258:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185609.220908:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812349952 00000100:00100000:1.0:1789185609.220925:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812349952 00000100:00100000:1.0:1789185609.221059:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:1.0:1789185609.221073:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+30:10340:x1876096812349952:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:1.0:1789185609.221182:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bd2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.221204:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bd2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.221218:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bd2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.221236:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272bd33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.221244:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272bd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.221251:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272bd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.221896:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bd3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.221916:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bd3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.221952:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bd3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185609.222019:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bd3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222036:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bd2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222055:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bd2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222063:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bd2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222069:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185609.222074:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bd2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222082:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bd2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222096:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:1.0:1789185609.222099:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185609.222104:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bd2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222110:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272bd2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222127:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272bd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222141:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272bd33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222148:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272bd33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222154:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4de00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185609.222157:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272bd33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222163:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272bd33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222172:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c791aedc900) 00010000:00010000:1.0:1789185609.222175:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185609.222177:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272bd33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222184:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272bd33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222201:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bd3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222208:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bd3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222213:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bd3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222217:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4ce00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185609.222226:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bd3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222234:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bd3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222241:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:1.0:1789185609.222243:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185609.222246:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bd3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.222252:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272bd3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185609.222385:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+30:10340:x1876096812349952:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 1311us (2139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185609.222396:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:0.0:1789185609.225938:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185609.226118:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812350208 00000100:00100000:2.0:1789185609.226132:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812350208 00000100:00100000:2.0:1789185609.226244:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:2.0:1789185609.226258:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+30:10340:x1876096812350208:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789185609.226881:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+31:10340:x1876096812350208:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 623us (955us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789185609.226892:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:0.0:1789185609.273796:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185609.274092:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812350464 00000100:00100000:3.0:1789185609.274107:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812350464 00000100:00100000:3.0:1789185609.274189:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:3.0:1789185609.274202:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+31:10343:x1876096812350464:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185609.274238:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185609.274270:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bd41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d52f expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.274542:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.274823:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.274841:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.274861:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.274870:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.274878:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275063:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275074:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275082:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185609.275094:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789185609.275222:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275232:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275241:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275248:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185609.275253:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275263:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275278:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:3.0:1789185609.275282:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185609.275288:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275802:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275827:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275834:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275841:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275847:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185609.275850:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275857:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275867:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c79055dd700) 00010000:00010000:3.0:1789185609.275869:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185609.275872:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275878:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275948:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bd41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d52f expref: 34 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275984:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d52f expref: 33 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.275993:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:3.0:1789185609.275996:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185609.275999:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04e00, rc 0) 00000100:00100000:3.0:1789185609.276184:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+33:10343:x1876096812350464:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1982us (2400us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789185609.276196:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:1.0:1789185609.280544:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185609.280763:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812350592 00000100:00100000:2.0:1789185609.280777:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812350592 00000100:00100000:2.0:1789185609.280852:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:2.0:1789185609.280864:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+33:10343:x1876096812350592:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:2.0:1789185609.280957:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bd64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.280978:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bd64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.280992:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bd64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.281049:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bd64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.281058:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bd64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.281065:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bd64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.281072:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185609.281077:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bd64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.281086:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bd64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.281101:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:2.0:1789185609.281105:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185609.281110:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bd64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.281117:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bd64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185609.281332:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+33:10343:x1876096812350592:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 468us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.281341:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:0.0:1789185609.284691:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185609.285043:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812350848 00000100:00100000:2.0:1789185609.285057:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812350848 00000100:00100000:2.0:1789185609.285185:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:2.0:1789185609.285215:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+33:10343:x1876096812350848:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789185609.285917:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+34:10343:x1876096812350848:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 699us (1245us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789185609.285929:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:0.0:1789185609.499133:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185609.499271:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812351104 00000100:00100000:2.0:1789185609.499286:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812351104 00000100:00100000:2.0:1789185609.499458:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:2.0:1789185609.499471:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+34:10374:x1876096812351104:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:2.0:1789185609.499506:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185609.499535:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bd6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d536 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.499700:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bd72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.499718:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.499734:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185609.499749:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789185609.499983:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bd6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d536 expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.500009:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bd72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d536 expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.500043:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:2.0:1789185609.500046:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185609.500051:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6000, rc 0) 00000100:00100000:2.0:1789185609.500134:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:10374:x1876096812351104:12345-192.168.202.54@tcp:101:cat.0 Request processed in 666us (1014us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789185609.500142:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:1.0:1789185609.506091:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185609.506157:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185609.506240:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812351488 00000100:00100000:2.0:1789185609.506252:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812351488 00000100:00100000:2.0:1789185609.506356:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:2.0:1789185609.506368:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791f907c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:2371:x1876096812351488:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185609.506388:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185609.506443:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bd72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d536 expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.506467:0:6692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:2.0:1789185609.506474:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185609.506548:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791f907c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:2371:x1876096812351488:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 182us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.506571:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:3.0:1789185609.507665:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812351360 00000100:00100000:3.0:1789185609.507685:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812351360 00000100:00100000:3.0:1789185609.507740:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:3.0:1789185609.507750:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:10374:x1876096812351360:12345-192.168.202.54@tcp:35:cat.0 00000100:00100000:3.0:1789185609.508072:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:10374:x1876096812351360:12345-192.168.202.54@tcp:35:cat.0 Request processed in 322us (1995us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789185609.508080:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:1.0:1789185609.583634:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185609.583750:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812351744 00000100:00100000:3.0:1789185609.583764:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812351744 00000100:00100000:3.0:1789185609.583847:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:3.0:1789185609.583859:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:10380:x1876096812351744:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:3.0:1789185609.583896:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185609.583900:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789185609.583938:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272bcd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d50c expref: 36 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.583983:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:3.0:1789185609.583989:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185609.584011:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bd80 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d53d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.584180:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.584198:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d52f expref: 36 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.584207:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.584252:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d52f expref: 36 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.584270:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d52f expref: 36 pid: 11024 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185609.584285:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876096821819904:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185609.584499:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79103c19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185609.587101:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185609.587329:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812351872 00000100:00100000:0.0:1789185609.587343:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812351872 00010000:00010000:0.0:1789185609.587401:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd56 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d52f expref: 37 pid: 11024 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185609.587482:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:0.0:1789185609.587495:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+37:2372:x1876096812351872:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185609.587514:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185609.587522:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd56 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d52f expref: 37 pid: 11024 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.587540:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d52f expref: 37 pid: 11024 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185609.588103:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876096821819904:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185609.588182:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272bd56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d52f expref: 37 pid: 11024 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.589046:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:3.0:1789185609.589048:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.589058:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.589196:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.589207:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.592947:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185609.593078:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:2372:x1876096812351872:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5575us (5981us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185609.593096:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00010000:00010000:3.0:1789185609.593521:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.594247:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185609.594284:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789185609.594780:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bd80 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d53d expref: 37 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.594808:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d53d expref: 36 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.594819:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:3.0:1789185609.594822:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789185609.594827:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05a00, rc 0) 00000100:00100000:3.0:1789185609.594958:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:10380:x1876096812351744:12345-192.168.202.54@tcp:101:dd.0 Request processed in 11099us (11337us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789185609.594969:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:1.0:1789185609.599946:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185609.600093:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812352128 00000100:00100000:3.0:1789185609.600107:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812352128 00000100:00100000:3.0:1789185609.600239:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:3.0:1789185609.600253:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:10380:x1876096812352128:12345-192.168.202.54@tcp:36:dd.0 00010000:00010000:3.0:1789185609.600735:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.600760:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.600775:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789185609.601130:0:11024:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:3.0:1789185609.601173:0:11024:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000023a791a7 reply state 00000000376c8a2f transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185609.601184:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789185609.601654:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+39:10380:x1876096812352128:12345-192.168.202.54@tcp:36:dd.0 Request processed in 1402us (1819us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1789185609.601662:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00000020:00080000:3.0:1789185609.601677:0:11024:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789185609.607664:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.607696:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.607705:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.607711:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185609.607716:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.607725:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.607746:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:3.0:1789185609.607749:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185609.607756:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.607763:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bd95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185609.615757:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821820032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185609.615870:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185609.616371:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821820032 00000100:00100000:3.0:1789185609.616384:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821820032 00000100:00100000:3.0:1789185609.616485:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789185609.616496:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1876096821820032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185609.616527:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185609.616602:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1876096821820032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185609.616610:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789185609.616882:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821820032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789185609.872285:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185609.922896:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185609.923073:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812352256 00000100:00100000:2.0:1789185609.923084:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812352256 00000100:00100000:2.0:1789185609.923166:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:2.0:1789185609.923177:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:10394:x1876096812352256:12345-192.168.202.54@tcp:101:stat.0 00010000:00010000:2.0:1789185609.923203:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185609.923226:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bd9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d544 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.923643:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bda3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.923661:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bda3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.923684:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bda3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.923701:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.923707:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.923715:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.923802:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bdb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.923814:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d53d expref: 39 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.923823:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bdb1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.923858:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d53d expref: 39 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.923888:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d53d expref: 39 pid: 5824 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185609.923903:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821820160:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185609.924329:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79192ea0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185609.928592:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185609.929566:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821820160:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789185609.929599:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bdb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185609.929781:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812352512 00000100:00100000:3.0:1789185609.929791:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812352512 00000100:00100000:3.0:1789185609.929856:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:3.0:1789185609.929866:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+40:5612:x1876096812352512:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789185609.930838:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+41:5612:x1876096812352512:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 968us (2253us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789185609.930848:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1789185609.936554:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185609.936733:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812352640 00000100:00100000:2.0:1789185609.936744:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812352640 00010000:00010000:2.0:1789185609.936786:0:6692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d53d expref: 41 pid: 5824 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185609.936826:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:2.0:1789185609.936837:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+41:2371:x1876096812352640:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185609.936854:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185609.936861:0:6692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d53d expref: 41 pid: 5824 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.936879:0:6692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d53d expref: 41 pid: 5824 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.936904:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272bd87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d53d expref: 41 pid: 5824 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.936941:0:6692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:2.0:1789185609.937022:0:6692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bdb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.937033:0:6692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.937041:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bdb1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.937080:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185609.937329:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+40:2371:x1876096812352640:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 492us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.937337:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00010000:00010000:3.0:1789185609.937549:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937559:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185609.937619:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789185609.937625:0:5822:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789185609.937702:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937718:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937736:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bda3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937743:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bda3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937751:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bda3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937758:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185609.937762:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bda3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937771:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bda3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937782:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:3.0:1789185609.937785:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185609.937790:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bda3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937796:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bda3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937809:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937815:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937821:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937834:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185609.937837:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937844:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937853:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c792334a000) 00010000:00010000:3.0:1789185609.937855:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185609.937858:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937864:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937903:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bd9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d544 expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937917:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bdb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d544 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.937924:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:3.0:1789185609.937926:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185609.937928:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7600, rc 0) 00000100:00100000:3.0:1789185609.938241:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+39:10394:x1876096812352256:12345-192.168.202.54@tcp:101:stat.0 Request processed in 15064us (15353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185609.938249:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:1.0:1789185610.069229:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185610.069347:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812352896 00000100:00100000:2.0:1789185610.069357:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812352896 00000100:00100000:2.0:1789185610.069483:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:2.0:1789185610.069495:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+39:10400:x1876096812352896:12345-192.168.202.54@tcp:36:truncate.0 00010000:00010000:2.0:1789185610.069573:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185610.069599:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bdb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d544 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.069620:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:2.0:1789185610.069625:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185610.069855:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bdb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.069871:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bdb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.069889:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bdb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185610.069942:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:2.0:1789185610.069968:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a2a2f965 reply state 000000006539ff83 transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bdb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185610.069977:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185610.070085:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+41:10400:x1876096812352896:12345-192.168.202.54@tcp:36:truncate.0 Request processed in 593us (866us total) trans 4294967339 rc 0/0 00000100:00100000:2.0:1789185610.070092:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 54 00000020:00080000:2.0:1789185610.070096:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1789185610.070501:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789185610.073891:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bdb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.073910:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bdb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.073918:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bdb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.073924:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185610.073929:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bdb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.073937:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bdb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.074016:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:3.0:1789185610.074020:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185610.074025:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bdb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.074030:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bdb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185610.407695:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185610.407785:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812353024 00000100:00100000:3.0:1789185610.407796:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812353024 00000100:00100000:3.0:1789185610.407863:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:3.0:1789185610.407873:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+40:10414:x1876096812353024:12345-192.168.202.54@tcp:101:stat.0 00010000:00010000:3.0:1789185610.407900:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185610.407925:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bdbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d54b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408015:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bdc6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408029:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bdc6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408041:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bdc6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408056:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408064:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408071:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408157:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bdd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408166:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bdd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408173:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bdd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185610.408210:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789185610.408215:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789185610.408237:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bdd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408263:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bdd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408272:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bdc6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408279:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bdc6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408286:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bdc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408293:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185610.408298:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bdc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408307:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bdc6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408333:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:3.0:1789185610.408336:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185610.408342:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bdc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408348:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272bdc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408362:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408369:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdcd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408381:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408385:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185610.408389:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408394:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408402:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c79055dd700) 00010000:00010000:3.0:1789185610.408465:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185610.408470:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdcd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408475:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408509:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bdbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d54b expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408522:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bdd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d54b expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.408528:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:3.0:1789185610.408530:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185610.408532:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04400, rc 0) 00000100:00100000:3.0:1789185610.408600:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+41:10414:x1876096812353024:12345-192.168.202.54@tcp:101:stat.0 Request processed in 728us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185610.408616:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:0.0:1789185610.524199:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185610.524386:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812353280 00000100:00100000:2.0:1789185610.524396:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812353280 00000100:00100000:2.0:1789185610.524494:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:2.0:1789185610.524504:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+41:10424:x1876096812353280:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185610.524525:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185610.524546:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bddb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d552 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185610.524639:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789185610.524776:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bddb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d552 expref: 43 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.524790:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:2.0:1789185610.524793:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185610.524798:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bddb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d552 expref: 43 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.524831:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7600, rc 0) 00000100:00100000:2.0:1789185610.524909:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+42:10424:x1876096812353280:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 406us (720us total) trans 4294967340 rc 301/301 00000100:00100000:2.0:1789185610.524917:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:1.0:1789185610.535108:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185610.535778:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812353536 00000100:00100000:2.0:1789185610.535790:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812353536 00000100:00100000:2.0:1789185610.535849:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:2.0:1789185610.535861:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+42:10424:x1876096812353536:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789185610.536763:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+43:10424:x1876096812353536:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 899us (1660us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789185610.536773:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:1.0:1789185610.672579:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185610.672736:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812353792 00000100:00100000:3.0:1789185610.672748:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812353792 00000100:00100000:3.0:1789185610.672812:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:3.0:1789185610.672822:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+43:10430:x1876096812353792:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1789185610.672849:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185610.672870:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bde9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d559 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.672982:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.672997:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bdd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d54b expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.673006:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.673041:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bdd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d54b expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.673059:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bdd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d54b expref: 44 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185610.673073:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876096821820288:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185610.673169:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791aed2180 going to sleep for 11 seconds 00000100:00100000:3.0:1789185610.677369:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876096821820288:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185610.677456:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185610.684587:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185610.686261:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812353920 00000100:00100000:3.0:1789185610.686276:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812353920 00010000:00010000:3.0:1789185610.686340:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bdd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d54b expref: 45 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185610.686395:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:3.0:1789185610.686432:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+45:2371:x1876096812353920:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185610.686448:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185610.686455:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bdd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d54b expref: 45 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.686475:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bdd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d54b expref: 45 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.686498:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272bdd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d54b expref: 45 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.686514:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:3.0:1789185610.686520:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.686529:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.686537:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.686595:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185610.686671:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+44:2371:x1876096812353920:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 268us (2095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185610.686679:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 40 00010000:00010000:0.0:1789185610.686761:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.686770:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185610.686789:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789185610.686939:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272bde9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d559 expref: 45 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.686955:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d559 expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.686963:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:0.0:1789185610.686965:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789185610.686968:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05c00, rc 0) 00000100:00100000:0.0:1789185610.686992:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+44:10430:x1876096812353792:12345-192.168.202.54@tcp:101:bash.0 Request processed in 14173us (14424us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1789185610.687007:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:0.0:1789185610.695009:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185610.696018:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812354176 00000100:00100000:2.0:1789185610.696032:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812354176 00000100:00100000:2.0:1789185610.696102:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:2.0:1789185610.696114:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+44:10430:x1876096812354176:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:2.0:1789185610.696449:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdfe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.696467:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.696481:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185610.696536:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:2.0:1789185610.696563:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003822ca44 reply state 000000006752b61e transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185610.696584:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185610.696808:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+47:10430:x1876096812354176:12345-192.168.202.54@tcp:36:bash.0 Request processed in 695us (1809us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789185610.696816:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 58 00000020:00080000:2.0:1789185610.696821:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789185610.706184:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.706201:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdfe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.706209:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdfe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.706215:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185610.706220:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdfe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.706228:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdfe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.706244:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:3.0:1789185610.706247:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185610.706251:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdfe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.706266:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bdfe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185610.708251:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185610.708739:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812354304 00000100:00100000:3.0:1789185610.708752:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812354304 00000100:00100000:3.0:1789185610.708822:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:3.0:1789185610.708833:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+46:10430:x1876096812354304:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1789185610.708860:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185610.708896:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272be05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d560 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.708981:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272be0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.708996:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d559 expref: 47 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.709004:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272be0c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.709039:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d559 expref: 47 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.709057:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d559 expref: 47 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185610.709072:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821820416:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185610.709159:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791aed2180 going to sleep for 11 seconds 00000100:00100000:2.0:1789185610.715009:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185610.715129:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812354432 00000100:00100000:0.0:1789185610.715138:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812354432 00010000:00010000:0.0:1789185610.715184:0:6692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d559 expref: 48 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185610.715223:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:0.0:1789185610.715231:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+48:2372:x1876096812354432:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185610.715243:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185610.715249:0:6692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d559 expref: 48 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.715268:0:6692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d559 expref: 48 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.715291:0:6692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:0.0:1789185610.715295:0:6692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272be0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.715303:0:6692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272be0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.715308:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272be0c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.715327:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185610.715372:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+48:2372:x1876096812354432:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 142us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185610.715393:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 41 00010000:00010000:3.0:1789185610.717738:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bdf0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d559 expref: 47 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185610.717758:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821820416:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185610.717778:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272be0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.719737:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272be0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.719754:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272be0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185610.719806:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789185610.719811:0:5822:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789185610.719832:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272be0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.719871:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272be05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d560 expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.719890:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272be0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d560 expref: 46 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.719899:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:2.0:1789185610.719902:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185610.719905:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05000, rc 0) 00000100:00100000:2.0:1789185610.719990:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+46:10430:x1876096812354304:12345-192.168.202.54@tcp:101:bash.0 Request processed in 11158us (11747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185610.720013:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:2.0:1789185610.723688:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185610.723760:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812354688 00000100:00100000:3.0:1789185610.723770:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812354688 00000100:00100000:3.0:1789185610.723823:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:3.0:1789185610.723832:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791916e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+46:10430:x1876096812354688:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:3.0:1789185610.724042:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791916e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+47:10430:x1876096812354688:12345-192.168.202.54@tcp:35:bash.0 Request processed in 210us (363us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789185610.724050:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:1.0:1789185610.820957:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185610.821022:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812354944 00000100:00100000:2.0:1789185610.821032:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812354944 00000100:00100000:2.0:1789185610.821158:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:2.0:1789185610.821170:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+47:10440:x1876096812354944:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185610.821193:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185610.821213:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272be13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d567 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185610.821307:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789185610.821553:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272be13 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d567 expref: 49 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.822166:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:2.0:1789185610.822169:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185610.822176:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272be13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d567 expref: 49 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.822193:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7600, rc 0) 00000100:00100000:2.0:1789185610.822373:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+48:10440:x1876096812354944:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1205us (1424us total) trans 4294967346 rc 301/301 00000100:00100000:2.0:1789185610.822382:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:0.0:1789185610.830697:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185610.830882:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812355072 00000100:00100000:1.0:1789185610.830898:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812355072 00000100:00100000:1.0:1789185610.830994:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:1.0:1789185610.831007:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+48:10440:x1876096812355072:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:1.0:1789185610.831096:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272be21 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831114:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272be21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831126:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272be21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831140:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272be28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831147:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272be28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831155:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272be28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831257:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272be2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831267:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272be2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831274:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272be2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185610.831334:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272be2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831347:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272be21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831354:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272be21 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831362:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272be21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831370:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185610.831374:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272be21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831382:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272be21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831393:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:1.0:1789185610.831501:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185610.831507:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272be21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831520:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272be21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831532:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272be28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831537:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272be28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831543:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272be28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831547:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185610.831550:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272be28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831555:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272be28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831716:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c791aedc900) 00010000:00010000:1.0:1789185610.831718:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185610.831722:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272be28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831728:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272be28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831743:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272be2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831750:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272be2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831762:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272be2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831767:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4de00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185610.831769:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272be2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831775:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272be2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831784:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:1.0:1789185610.831786:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185610.831789:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272be2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.831794:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272be2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185610.831883:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+48:10440:x1876096812355072:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 878us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185610.831893:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:2.0:1789185610.834996:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185610.835090:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812355328 00000100:00100000:3.0:1789185610.835101:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812355328 00000100:00100000:3.0:1789185610.835159:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:3.0:1789185610.835170:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+48:10440:x1876096812355328:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789185610.835756:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+49:10440:x1876096812355328:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 586us (769us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789185610.835764:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:3.0:1789185610.893208:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185610.893353:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812355584 00000100:00100000:0.0:1789185610.893365:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812355584 00000100:00100000:0.0:1789185610.893481:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:0.0:1789185610.893491:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+49:10443:x1876096812355584:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789185610.893516:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185610.893536:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d56e expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.893621:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be3d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.893637:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.893648:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.893672:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.893679:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.893685:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.893800:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.893824:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.893831:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185610.893843:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789185610.893944:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.893953:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.893960:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.893966:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185610.893971:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.893980:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.893992:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:0.0:1789185610.893996:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185610.894002:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.894009:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.894022:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.894034:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.894041:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.894046:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185610.894050:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.894057:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.894065:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c79117a4800) 00010000:00010000:0.0:1789185610.894068:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185610.894071:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.894077:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.894124:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d56e expref: 52 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.894138:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d56e expref: 51 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.894145:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:0.0:1789185610.894148:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185610.894157:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355600, rc 0) 00000100:00100000:0.0:1789185610.894218:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+51:10443:x1876096812355584:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 728us (1021us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789185610.894225:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 62 00010000:00010000:0.0:1789185610.896787:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185610.903040:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185610.903123:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812355712 00000100:00100000:2.0:1789185610.903132:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812355712 00000100:00100000:2.0:1789185610.903243:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:2.0:1789185610.903255:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+51:10443:x1876096812355712:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:2.0:1789185610.903339:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272be59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.903357:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272be59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.903369:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272be59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.903433:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272be59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.903441:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272be59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.903448:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272be59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.903454:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185610.903458:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272be59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.903467:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272be59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.903478:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:2.0:1789185610.903481:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185610.903486:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272be59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185610.903504:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272be59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185610.903880:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+51:10443:x1876096812355712:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 625us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185610.903889:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:1.0:1789185610.914360:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185610.914491:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812355840 00000100:00100000:3.0:1789185610.914501:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812355840 00000100:00100000:3.0:1789185610.914576:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:3.0:1789185610.914587:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+51:2372:x1876096812355840:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185610.914603:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185610.914628:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d56e expref: 51 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185610.914647:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:3.0:1789185610.914675:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185610.914746:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+50:2372:x1876096812355840:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 160us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185610.914753:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:1.0:1789185610.915231:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185610.916562:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812356096 00000100:00100000:2.0:1789185610.916574:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812356096 00000100:00100000:2.0:1789185610.916679:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:2.0:1789185610.916690:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+50:10443:x1876096812356096:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789185610.917009:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+51:10443:x1876096812356096:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 320us (1778us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789185610.917018:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:2.0:1789185611.115807:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185611.115932:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812356352 00000100:00100000:0.0:1789185611.115942:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812356352 00000100:00100000:0.0:1789185611.116003:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:0.0:1789185611.116013:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+51:10461:x1876096812356352:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:0.0:1789185611.116039:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185611.116060:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d575 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.116156:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be67 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.116170:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.116183:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185611.116194:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789185611.116331:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d575 expref: 54 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.116350:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d575 expref: 53 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.116379:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:0.0:1789185611.116382:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789185611.116386:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354600, rc 0) 00000100:00100000:0.0:1789185611.116610:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+53:10461:x1876096812356352:12345-192.168.202.54@tcp:101:cat.0 Request processed in 598us (812us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789185611.116617:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:1.0:1789185611.156321:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185611.156464:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812356480 00000100:00100000:0.0:1789185611.156475:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812356480 00000100:00100000:0.0:1789185611.156537:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:0.0:1789185611.156549:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+53:10462:x1876096812356480:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789185611.156582:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185611.156605:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d57c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.156688:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.156703:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.156716:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185611.156754:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789185611.156758:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185611.156776:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.156820:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d57c expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.156835:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d57c expref: 54 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.156841:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:0.0:1789185611.156843:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185611.156847:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355800, rc 0) 00000100:00100000:0.0:1789185611.157008:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+54:10462:x1876096812356480:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 462us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185611.157013:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:2.0:1789185611.163261:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185611.163333:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812356864 00000100:00100000:3.0:1789185611.163344:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812356864 00000100:00100000:3.0:1789185611.163401:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:3.0:1789185611.163434:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+54:10462:x1876096812356864:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789185611.163805:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+55:10462:x1876096812356864:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 372us (554us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1789185611.163812:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:3.0:1789185611.166096:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185611.166219:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812356992 00000100:00100000:0.0:1789185611.166229:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812356992 00000100:00100000:0.0:1789185611.166303:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:0.0:1789185611.166313:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+55:10462:x1876096812356992:12345-192.168.202.54@tcp:103:lfs.0 00010000:00010000:0.0:1789185611.166336:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789185611.166360:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272be0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d560 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.166382:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d575 expref: 54 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.166394:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bd17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d521 expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.166479:0:6692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a900) 00010000:00010000:0.0:1789185611.166489:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185611.166548:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+52:10462:x1876096812356992:12345-192.168.202.54@tcp:103:lfs.0 Request processed in 235us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185611.166555:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:1.0:1789185611.169849:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185611.170151:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812357120 00000100:00100000:2.0:1789185611.170161:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812357120 00000100:00100000:2.0:1789185611.170219:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:2.0:1789185611.170229:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+52:10462:x1876096812357120:12345-192.168.202.54@tcp:58:lfs.0 00010000:00010000:2.0:1789185611.170363:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272be83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.170380:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272be83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.170392:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272be83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789185611.170743:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185611.170943:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789185611.171013:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789185611.171129:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+52:10462:x1876096812357120:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 899us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185611.171137:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:3.0:1789185611.198202:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185611.198353:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812357248 00000100:00100000:0.0:1789185611.198364:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812357248 00000100:00100000:0.0:1789185611.198457:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:0.0:1789185611.198467:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+52:10464:x1876096812357248:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789185611.198489:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185611.198510:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d583 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198597:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198611:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198622:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198638:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272be98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198645:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272be98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198679:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272be98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198769:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198777:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198784:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185611.198822:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789185611.198826:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185611.198844:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198856:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198864:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198871:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198878:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198884:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185611.198888:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198902:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198915:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:0.0:1789185611.198918:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185611.198923:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198929:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272be91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198944:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272be98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198950:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272be98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198956:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272be98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198962:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185611.198964:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272be98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198971:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272be98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198977:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c79117a4800) 00010000:00010000:0.0:1789185611.198981:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185611.198983:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272be98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.198999:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272be98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.199033:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272be8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d583 expref: 54 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.199046:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d583 expref: 53 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.199054:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a200) 00010000:00010000:0.0:1789185611.199056:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185611.199059:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355600, rc 0) 00000100:00100000:0.0:1789185611.199133:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+53:10464:x1876096812357248:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 667us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185611.199140:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 67 00000001:00080000:0.0:1789185611.730634:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:0.0:1789185611.730702:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1789185611.730725:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c79192ea000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789185611.730730:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c793f580f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c79192ea540 00000020:00080000:0.0:1789185611.730742:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c793f580900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c792fa79400 00000001:00080000:0.0:1789185611.730771:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000020:00080000:2.0:1789185611.730948:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789185611.731107:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789185611.731693:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185611.731716:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821820544:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789185611.731793:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185611.731823:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821820544 00000100:00100000:0.0:1789185611.731831:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821820544 00000100:00100000:0.0:1789185611.731893:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789185611.731904:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1876096821820544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789185611.731929:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1789185611.731969:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa4ce48, atime: 0x6aa4ce48, ctime: 0x6aa4ce48, blocks: 0x1 00010000:00010000:0.0:1789185611.731977:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a391d91a/0x532743011272bea6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.731993:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=308s v=(0 0) 00010000:00010000:0.0:1789185611.731997:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185611.732004:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a391d91a/0x532743011272bea6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.732018:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a391d91a/0x532743011272bea6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.732028:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a391d91a/0x532743011272bea6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.732035:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a391d91a/0x532743011272bea6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.732060:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789185611.732236:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185611.732242:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a391d91a/0x532743011272bea6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.732250:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355e00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185611.732255:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a391d91a/0x532743011272bea6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.732263:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a391d91a/0x532743011272bea6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.732278:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a391d91a/0x532743011272bea6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.732285:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a391d91a/0x532743011272bea6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.732317:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185611.732320:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185611.732321:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789185611.732661:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185611.732968:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3281:x1876096821820544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1065us (1174us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789185611.732976:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1789185611.733076:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7936b5d880/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789185611.733083:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821820544:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1789185611.791995:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789185611.792008:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789185611.792076:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789185611.792084:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789185611.792221:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1876096821820672:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789185611.792485:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c792f6a1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789185611.810694:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185611.810786:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812357376 00000100:00100000:1.0:1789185611.810796:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812357376 00000100:00100000:1.0:1789185611.810857:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:1.0:1789185611.810870:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:10475:x1876096812357376:12345-192.168.202.54@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789185611.810974:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:10475:x1876096812357376:12345-192.168.202.54@tcp:900:lhsmtool_posix.0 Request processed in 107us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185611.810982:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:2.0:1789185611.811197:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1876096821820672:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789185611.819863:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185611.819897:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812357504 00000100:00100000:2.0:1789185611.819905:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812357504 00000100:00100000:2.0:1789185611.819967:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:2.0:1789185611.819976:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+11:10475:x1876096812357504:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789185611.820004:0:5823:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789185611.820104:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+11:10475:x1876096812357504:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 129us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185611.820111:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:1.0:1789185611.834400:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185611.834657:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812357632 00000100:00100000:0.0:1789185611.834667:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812357632 00000100:00100000:0.0:1789185611.834724:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:0.0:1789185611.834734:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+11:10475:x1876096812357632:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789185611.834803:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bead lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.834820:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bead lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.834832:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bead lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.834848:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272beb4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.834855:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272beb4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.834862:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272beb4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.834898:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bebb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.834907:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.834913:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185611.834964:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789185611.834968:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185611.834980:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.834991:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bead lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.834997:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bead lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835004:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bead lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835009:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185611.835013:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bead lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835020:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bead lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835033:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c792334af00) 00010000:00010000:0.0:1789185611.835035:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185611.835040:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bead lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835045:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272bead lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835056:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272beb4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835070:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272beb4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835076:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272beb4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835081:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185611.835084:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272beb4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835089:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272beb4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835097:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9c79117a4f00) 00010000:00010000:0.0:1789185611.835099:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185611.835102:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272beb4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835107:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272beb4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835121:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835127:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bebb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835132:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bebb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835136:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185611.835145:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bebb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835151:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bebb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835158:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a200) 00010000:00010000:0.0:1789185611.835160:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185611.835163:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bebb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.835353:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bebb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185611.835461:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+11:10475:x1876096812357632:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 Request processed in 727us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185611.835469:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:3.0:1789185611.850589:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185611.850682:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812357888 00000100:00100000:2.0:1789185611.850692:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812357888 00000100:00100000:2.0:1789185611.850754:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:2.0:1789185611.850766:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+11:10475:x1876096812357888:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185611.850788:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185611.850810:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bec2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d58a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.850909:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bec9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.850933:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bec9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.850945:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bec9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185611.850958:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789185611.851499:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bec9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.851510:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bec9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.851518:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bec9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.851524:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185611.851529:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bec9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.851536:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bec9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.851549:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a200) 00010000:00010000:2.0:1789185611.851553:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185611.851560:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bec9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.851567:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bec9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.851613:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bec2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d58a expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.851633:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c792334af00) 00010000:00010000:2.0:1789185611.851636:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185611.851640:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bec2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d58a expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.851662:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7000, rc 0) 00000100:00100000:2.0:1789185611.851737:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:10475:x1876096812357888:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 973us (1157us total) trans 4294967352 rc 301/301 00000100:00100000:2.0:1789185611.851746:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:2.0:1789185611.861595:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185611.864720:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812358016 00000100:00100000:1.0:1789185611.864733:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812358016 00000100:00100000:1.0:1789185611.865814:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:1.0:1789185611.865830:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:10475:x1876096812358016:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789185611.865870:0:5824:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789185611.865998:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:10475:x1876096812358016:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 172us (4412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185611.866006:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:1.0:1789185611.871457:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185611.871500:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812358272 00000100:00100000:1.0:1789185611.871509:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812358272 00000100:00100000:1.0:1789185611.871564:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:1.0:1789185611.871574:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:10475:x1876096812358272:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185611.871595:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185611.871598:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789185611.871625:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272be7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d57c expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185611.871641:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:1.0:1789185611.871664:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185611.871678:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bed7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d591 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789185611.872442:0:11024:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789185611.872709:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bede lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185611.872726:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bede lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185611.872737:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bede lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185611.872794:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272bed7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d591 expref: 14 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185611.872812:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bede lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d591 expref: 13 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185611.872820:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c791aedc200) 00010000:00010000:1.0:1789185611.872823:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185611.872826:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4dc00, rc 0) 00000100:00100000:1.0:1789185611.872917:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:10475:x1876096812358272:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1344us (1468us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1789185611.872927:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:0.0:1789185611.880525:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185611.883850:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812358528 00000100:00100000:2.0:1789185611.883864:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812358528 00000100:00100000:2.0:1789185611.883929:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:2.0:1789185611.883940:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:10475:x1876096812358528:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789185611.884006:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185611.884033:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272bede lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d591 expref: 13 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884052:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c791aedc200) 00010000:00010000:2.0:1789185611.884064:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185611.884087:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272beec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884102:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272beec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884128:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272beec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884208:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bef3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xaaaceae8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884217:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bef3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaaaceae8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884225:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bef3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaaaceae8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884459:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272beec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884469:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272beec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884475:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272beec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884481:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185611.884486:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272beec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884493:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272beec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884502:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:2.0:1789185611.884505:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185611.884510:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272beec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884523:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272beec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884534:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bef3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaaaceae8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884540:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bef3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaaaceae8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884547:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bef3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaaaceae8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884551:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185611.884555:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bef3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaaaceae8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884561:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bef3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaaaceae8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884568:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xaaaceae8 (ffff9c792334a100) 00010000:00010000:2.0:1789185611.884571:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185611.884573:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bef3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xaaaceae8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.884580:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bef3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xaaaceae8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185611.884679:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:10475:x1876096812358528:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 739us (4163us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789185611.884686:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:1.0:1789185611.888997:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185611.889091:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812358656 00000100:00100000:0.0:1789185611.889102:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812358656 00000100:00100000:0.0:1789185611.889159:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:0.0:1789185611.889169:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:10475:x1876096812358656:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185611.889187:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185611.889208:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272befa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d598 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.889244:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bf01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.889257:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bf01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.889282:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bf01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.889379:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272befa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d598 expref: 14 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.889397:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bf01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d598 expref: 13 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185611.889437:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c79117a4f00) 00010000:00010000:0.0:1789185611.889441:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789185611.889444:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354e00, rc 0) 00000100:00100000:0.0:1789185611.889501:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:10475:x1876096812358656:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 333us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185611.889508:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:1.0:1789185611.905109:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185611.905200:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812358912 00000100:00100000:3.0:1789185611.905216:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812358912 00000100:00100000:3.0:1789185611.905300:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:3.0:1789185611.905318:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:10475:x1876096812358912:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789185611.905483:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185611.905504:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185611.905518:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789185611.905917:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1789185611.905928:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 308945522334ns, next at 309945519953ns, rc = 0 00000004:00010000:3.0:1789185611.906032:0:5822:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000066cce82d reply state 00000000b0bd3730 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185611.906043:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789185611.906180:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:10475:x1876096812358912:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 862us (1083us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789185611.906189:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 75 00010000:00010000:3.0:1789185611.919366:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185611.919391:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185611.919401:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185611.919443:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185611.919450:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185611.919458:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185611.919482:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c79117a4f00) 00010000:00010000:3.0:1789185611.919486:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789185611.919493:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185611.919522:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185611.919698:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185611.921499:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185611.921616:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812359040 00000100:00100000:2.0:1789185611.921628:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812359040 00000100:00100000:2.0:1789185611.921688:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:2.0:1789185611.921698:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:10475:x1876096812359040:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185611.921725:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185611.921746:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bf0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d59f expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.921807:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bf0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d59f expref: 15 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.921822:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bf0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d59f expref: 15 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185611.921849:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c79117a4f00) 00010000:00010000:2.0:1789185611.921852:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185611.921856:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6000, rc 0) 00000100:00100000:2.0:1789185611.921920:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:10475:x1876096812359040:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 223us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185611.921927:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:3.0:1789185611.927042:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185611.927295:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812359168 00000100:00100000:1.0:1789185611.927313:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812359168 00000100:00100000:1.0:1789185611.927515:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1789185611.927524:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2368:x1876096812359168:12345-192.168.202.54@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789185611.927558:0:6678:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp t0 exp 0000000000000000 cur 308 last 0 00000020:00000080:1.0:1789185611.927593:0:6678:0:(genops.c:1384:class_connect()) connect: client 19bfb1a3-97ed-41fd-ac10-946cffd5be7d, cookie 0x532743011272bf16 00002000:00100000:1.0:1789185611.927605:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 19bfb1a3-97ed-41fd-ac10-946cffd5be7d/ffff9c792fe6b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789185611.927632:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:1.0:1789185611.927872:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789185611.928742:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9c792fe6c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185611.928844:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2368:x1876096812359168:12345-192.168.202.54@tcp:8:lhsmtool_posix.0 Request processed in 1304us (1803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185611.928855:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1789185611.945732:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185611.947326:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812359296 00000100:00100000:2.0:1789185611.947398:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812359296 00000100:00100000:2.0:1789185611.947502:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:2.0:1789185611.947514:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:0:x1876096812359296:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789185611.947998:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1789185612.038837:0:11998:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789185612.038848:0:11998:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789185612.038883:0:11998:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789185612.038889:0:11998:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789185612.039915:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:0:x1876096812359296:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 92395us (94187us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789185612.039926:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000001:00100000:3.0:1789185612.040005:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000001:00080000:3.0:1789185612.040022:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1789185612.055593:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185612.055665:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812359552 00000100:00100000:2.0:1789185612.055676:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812359552 00000100:00100000:2.0:1789185612.055775:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:2.0:1789185612.055788:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:10475:x1876096812359552:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789185612.056031:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:10475:x1876096812359552:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 247us (449us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789185612.056037:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00080000:1.0:1789185612.056793:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185612.096759:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185612.096858:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812359808 00000100:00100000:3.0:1789185612.096869:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812359808 00000100:00100000:3.0:1789185612.096934:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:3.0:1789185612.096946:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:10475:x1876096812359808:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789185612.097062:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:10475:x1876096812359808:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 118us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185612.097070:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:2.0:1789185612.110884:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185612.110954:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812359936 00000100:00100000:3.0:1789185612.110965:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812359936 00000100:00100000:3.0:1789185612.111271:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:3.0:1789185612.111291:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:10475:x1876096812359936:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185612.111315:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185612.111343:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d5a6 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.111446:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272bf24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.111461:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272bf24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.111480:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272bf24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185612.111515:0:11024:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789185612.111530:0:11024:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272bf24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.111553:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5a6 expref: 18 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.112450:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272bf24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5a6 expref: 17 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.112461:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c79117a4f00) 00010000:00010000:3.0:1789185612.112463:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789185612.112468:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04c00, rc 0) 00000100:00100000:3.0:1789185612.112542:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+17:10475:x1876096812359936:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1261us (1667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185612.112551:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:3.0:1789185612.126326:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185612.126456:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812360064 00000100:00100000:0.0:1789185612.126466:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812360064 00000100:00100000:0.0:1789185612.126516:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:0.0:1789185612.126526:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2371:x1876096812360064:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185612.126545:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185612.126570:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272bf2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d5ad expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789185612.126615:0:6884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4ce4b, blocks: 0x1 00010000:00010000:0.0:1789185612.126637:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=309s v=(0 0) 00010000:00010000:0.0:1789185612.126641:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185612.126661:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272bf2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ad expref: 6 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.126681:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272bf2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ad expref: 6 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.126694:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355a00, rc 0) 00000100:00100000:0.0:1789185612.126752:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2371:x1876096812360064:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 226us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185612.126759:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:0.0:1789185612.132641:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185612.132821:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812360320 00000100:00100000:3.0:1789185612.132832:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812360320 00000100:00100000:3.0:1789185612.132900:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:3.0:1789185612.132912:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+17:10475:x1876096812360320:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789185612.133039:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+17:10475:x1876096812360320:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 129us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185612.133047:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:2.0:1789185612.149762:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185612.149835:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812360448 00000100:00100000:1.0:1789185612.149846:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812360448 00000100:00100000:1.0:1789185612.149904:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:1.0:1789185612.149914:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:10475:x1876096812360448:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185612.149933:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185612.149955:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a157e55/0x532743011272bf32 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d5b4 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185612.149989:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272bf2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ad expref: 7 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185612.150011:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185612.150015:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185612.150021:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a157e55/0x532743011272bf32 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5b4 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185612.150057:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272bf2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ad expref: 7 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185612.150075:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272bf2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ad expref: 7 pid: 6884 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185612.150090:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876096821820800:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789185612.150177:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906588240 going to sleep for 11 seconds 00000100:00100000:1.0:1789185612.161906:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185612.162144:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812360576 00000100:00100000:3.0:1789185612.162154:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812360576 00010000:00010000:3.0:1789185612.162197:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272bf2b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ad expref: 8 pid: 6884 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185612.162241:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:3.0:1789185612.162251:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791f904850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2372:x1876096812360576:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185612.162266:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185612.162388:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272bf2b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ad expref: 8 pid: 6884 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.162439:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272bf2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ad expref: 8 pid: 6884 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.162468:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185612.162473:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185612.162481:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a157e55/0x532743011272bf32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5b4 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.162491:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a157e55/0x532743011272bf32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5b4 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.162528:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a157e55/0x532743011272bf32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5b4 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185612.162543:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5808:1876096821820928:192.168.202.54@tcp:105: 00000100:00100000:3.0:1789185612.162658:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907e73600 going to sleep for 11 seconds 00010000:00010000:3.0:1789185612.162694:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272bf2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ad expref: 8 pid: 6884 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185612.162710:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876096821820800:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185612.162735:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a157e55/0x532743011272bf32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5b4 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.162745:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4c000, rc 0) 00000100:00100000:3.0:1789185612.162773:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:10475:x1876096812360448:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 12860us (13017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185612.162781:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:3.0:1789185612.166036:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5808:1876096821820928:192.168.202.54@tcp:105: 00010000:00010000:3.0:1789185612.166068:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185612.166122:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791f904850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812360576:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3871us (4226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185612.166133:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:3.0:1789185612.167223:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185612.167256:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812360704 00000100:00100000:3.0:1789185612.167263:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812360704 00002000:00100000:3.0:1789185612.167316:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9c7936b5c000 x1876096812360704/t0(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:213/0 lens 504/0 e 0 to 0 dl 1789185623 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789185612.167327:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7936b5c000 with x1876096812360704 ext(0->8) 00002000:00010000:3.0:1789185612.167333:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7936b5c000 00000100:00100000:3.0:1789185612.167359:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:3.0:1789185612.167381:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2369:x1876096812360704:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789185612.168006:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2369:x1876096812360704:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 Request processed in 625us (784us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789185612.168015:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00002000:00100000:3.0:1789185612.168023:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9c7936b5c000 x1876096812360704/t4294967302(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:213/0 lens 504/448 e 0 to 0 dl 1789185623 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789185612.168032:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7936b5c000 with x1876096812360704 ext(0->8) 00002000:00010000:3.0:1789185612.168036:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7936b5c000 00000100:00100000:3.0:1789185612.175622:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185612.175713:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812360832 00000100:00100000:1.0:1789185612.175724:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812360832 00000100:00100000:1.0:1789185612.175783:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:1.0:1789185612.175793:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+17:10475:x1876096812360832:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789185612.255343:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000001:00080000:3.0:1789185612.255360:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000020:00080000:3.0:1789185612.255370:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:3.0:1789185612.255383:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789185612.255400:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1789185612.255429:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789185612.255553:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821821056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789185612.255624:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185612.255708:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821821056 00000100:00100000:3.0:1789185612.255716:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821821056 00000100:00100000:3.0:1789185612.255776:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789185612.255786:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821821056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789185612.255932:0:6884:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789185612.255936:0:6884:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789185611 00002000:00010000:3.0:1789185612.255939:0:6884:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789185612.255941:0:6884:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789185611 -> 1789185611 00002000:00010000:3.0:1789185612.255943:0:6884:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789185612.255997:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1876096821821056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 213us (373us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789185612.256005:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1789185612.256048:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7936b5ce00/2, rc 0, transno 4294967303 00000100:00100000:3.0:1789185612.256055:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821821056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789185612.256801:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:10475:x1876096812360832:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 Request processed in 81004us (81183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185612.256812:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00080000:2.0:1789185612.256923:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185612.260859:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185612.262446:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812360960 00000100:00100000:0.0:1789185612.262463:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812360960 00000100:00100000:0.0:1789185612.262535:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:0.0:1789185612.262546:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2372:x1876096812360960:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789185612.302515:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2372:x1876096812360960:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 Request processed in 39960us (41657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185612.302528:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00000001:00080000:1.0:1789185612.306545:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1789185612.306573:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1789185612.307515:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185612.307845:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812361216 00000100:00100000:2.0:1789185612.307856:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812361216 00000100:00100000:2.0:1789185612.307912:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:2.0:1789185612.307923:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:10475:x1876096812361216:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789185612.307983:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185612.308014:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272bf24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5a6 expref: 13 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.308037:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c79117a4f00) 00010000:00010000:2.0:1789185612.308043:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185612.308084:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.308099:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.308125:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185612.308461:0:5822:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000027820abf reply state 00000000a56d1f3e transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185612.308471:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185612.308587:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:10475:x1876096812361216:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 665us (1078us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1789185612.308595:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 81 00010000:00010000:3.0:1789185612.311132:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.311149:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.311156:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.311163:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185612.311168:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.311175:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.311193:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c79117a4f00) 00010000:00010000:3.0:1789185612.311195:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185612.311200:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.311205:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185612.315122:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185612.315247:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812361344 00000100:00100000:0.0:1789185612.315258:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812361344 00000100:00100000:0.0:1789185612.315332:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:0.0:1789185612.315344:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2371:x1876096812361344:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789185612.315657:0:6884:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789185612.315661:0:6884:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789185611 -> 1789185610 00002000:00010000:0.0:1789185612.315678:0:6884:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789185608 00002000:00010000:0.0:1789185612.315680:0:6884:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789185611 -> 1789185610 00002000:00010000:0.0:1789185612.315683:0:6884:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789185612.315745:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2371:x1876096812361344:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 403us (635us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789185612.315754:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:3.0:1789185612.321005:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185612.321114:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812361600 00000100:00100000:2.0:1789185612.321126:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812361600 00000100:00100000:2.0:1789185612.321188:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:2.0:1789185612.321199:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:10475:x1876096812361600:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789185612.321270:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.321300:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bf01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d598 expref: 13 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.321315:0:11024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf40 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.321349:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bf01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d598 expref: 13 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.321366:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bf01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d598 expref: 13 pid: 11024 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185612.321399:0:11024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1876096821821184:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185612.321510:0:11024:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185612.327919:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185612.328012:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812361728 00000100:00100000:0.0:1789185612.328022:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812361728 00010000:00010000:0.0:1789185612.328064:0:6692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bf01 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d598 expref: 14 pid: 11024 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185612.328103:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:0.0:1789185612.328112:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:2372:x1876096812361728:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185612.328127:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185612.328133:0:6692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bf01 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d598 expref: 14 pid: 11024 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.328149:0:6692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bf01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d598 expref: 14 pid: 11024 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.328171:0:6692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c79117a4f00) 00010000:00010000:0.0:1789185612.328177:0:6692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.328187:0:6692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.328195:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf40 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.328220:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185612.328514:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:2372:x1876096812361728:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 402us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185612.328522:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00010000:00010000:2.0:1789185612.328795:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272bf01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d598 expref: 13 pid: 11024 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185612.328813:0:11024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1876096821821184:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789185612.328836:0:11024:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.328845:0:11024:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.328851:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.328877:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.328884:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.328891:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.328897:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185612.328901:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.328920:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.328930:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c79117a4f00) 00010000:00010000:2.0:1789185612.328933:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789185612.328937:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.328943:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185612.328982:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:10475:x1876096812361600:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 Request processed in 7786us (7990us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789185612.328990:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:0.0:1789185612.333243:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185612.337490:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812361856 00000100:00100000:1.0:1789185612.337508:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812361856 00000100:00100000:0.0:1789185612.337899:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:0.0:1789185612.337910:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2370:x1876096812361856:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789185612.337960:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272bf47 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.337981:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a157e55/0x532743011272bf32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5b4 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.337990:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185612.337995:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789185612.338000:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272bf47 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.338038:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a157e55/0x532743011272bf32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5b4 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.338055:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a157e55/0x532743011272bf32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5b4 expref: 7 pid: 6676 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185612.338070:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876096821821312:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789185612.338172:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7929b2d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789185612.342138:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876096821821312:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185612.342166:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272bf47 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185612.343213:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185612.343321:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812361984 00000100:00100000:1.0:1789185612.343329:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812361984 00010000:00010000:1.0:1789185612.343368:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a157e55/0x532743011272bf32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5b4 expref: 8 pid: 6676 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185612.343441:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:1.0:1789185612.343450:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2372:x1876096812361984:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185612.343465:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185612.343488:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a157e55/0x532743011272bf32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5b4 expref: 8 pid: 6676 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185612.343505:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a157e55/0x532743011272bf32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5b4 expref: 8 pid: 6676 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185612.343530:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a157e55/0x532743011272bf32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5b4 expref: 8 pid: 6676 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185612.343548:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185612.343553:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185612.343560:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272bf47 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185612.343570:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272bf47 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185612.343625:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185612.343703:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2372:x1876096812361984:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 253us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185612.343711:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00010000:00010000:0.0:1789185612.344398:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272bf47 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.344448:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272bf47 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.344481:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272bf47 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.344488:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272bf47 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.344495:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272bf47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.344502:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354000 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185612.344506:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272bf47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.344513:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272bf47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.344539:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272bf47 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.344547:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272bf47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185612.344629:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812361856:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 Request processed in 6718us (11394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185612.344637:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:0.0:1789185612.349180:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185612.349259:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812362240 00000100:00100000:2.0:1789185612.349268:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812362240 00000100:00100000:2.0:1789185612.349335:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:2.0:1789185612.349344:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:10475:x1876096812362240:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789185612.349457:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.349476:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.349488:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.349715:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf55 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.349744:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bf0f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d59f expref: 13 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.349753:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf55 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.349785:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bf0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d59f expref: 13 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.349804:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bf0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d59f expref: 13 pid: 11024 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185612.349818:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821821440:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185612.349911:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185612.355825:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185612.355915:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812362368 00000100:00100000:1.0:1789185612.355925:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812362368 00010000:00010000:1.0:1789185612.355963:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bf0f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d59f expref: 14 pid: 11024 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185612.356006:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:1.0:1789185612.356016:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:2371:x1876096812362368:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185612.356031:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185612.356038:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bf0f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d59f expref: 14 pid: 11024 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185612.356054:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bf0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d59f expref: 14 pid: 11024 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185612.356075:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c79117a4f00) 00010000:00010000:1.0:1789185612.356080:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf55 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185612.356091:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185612.356099:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf55 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185612.356131:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185612.356187:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:2371:x1876096812362368:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 172us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185612.356194:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00010000:00010000:3.0:1789185612.356458:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bf0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d59f expref: 13 pid: 11024 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185612.356476:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821821440:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185612.356499:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.356508:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.356514:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789185612.356817:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1789185612.356955:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1789185612.356999:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789185612.357092:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876096821821568:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789185612.357139:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185612.357583:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79192aa900 going to sleep for 11 seconds 00000100:00100000:1.0:1789185612.359117:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821821568 00000100:00100000:1.0:1789185612.359128:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821821568 00000100:00100000:1.0:1789185612.359228:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789185612.359238:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1876096821821568:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789185612.359377:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1876096821821568:12345-0@lo:1000:mdt00_000.0 Request processed in 140us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185612.359385:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185612.359471:0:5822:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1789185612.359477:0:5822:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7936b5ce00, transno 4294967303 00000100:00100000:2.0:1789185612.359503:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876096821821568:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789185612.360050:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1789185612.360134:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876096821821696:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789185612.360174:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185612.360962:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee900 going to sleep for 11 seconds 00000100:00100000:3.0:1789185612.360994:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821821696 00000100:00100000:3.0:1789185612.361000:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821821696 00000100:00100000:3.0:1789185612.361036:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185612.361045:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1876096821821696:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789185612.361392:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5822:x1876096821821696:12345-0@lo:1000:mdt00_000.0 Request processed in 347us (1215us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789185612.361438:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789185612.362098:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876096821821696:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789185612.362140:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362161:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf55 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362168:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362173:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185612.362177:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362184:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf55 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362198:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c79117a4f00) 00010000:00010000:2.0:1789185612.362200:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185612.362205:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf55 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362210:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf55 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362246:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272be83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362253:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272be83 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362259:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272be83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362264:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185612.362273:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272be83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362768:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272be83 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362779:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a200) 00010000:00010000:2.0:1789185612.362782:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185612.362785:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272be83 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362791:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272be83 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362846:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf5c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362861:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d583 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362871:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf5c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362908:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d583 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185612.362928:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d583 expref: 16 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185612.362942:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821821824:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185612.363168:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185612.367790:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185612.368211:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812362496 00000100:00100000:0.0:1789185612.368222:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812362496 00010000:00010000:0.0:1789185612.368262:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be9f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d583 expref: 17 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185612.368320:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:0.0:1789185612.368331:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+17:2371:x1876096812362496:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185612.368347:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185612.368353:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be9f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d583 expref: 17 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.368369:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d583 expref: 17 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.368391:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a200) 00010000:00010000:0.0:1789185612.368435:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf5c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.368447:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.368456:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf5c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.368477:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185612.368533:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+17:2371:x1876096812362496:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 203us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185612.368541:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00010000:00010000:3.0:1789185612.369922:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272be9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d583 expref: 16 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185612.369947:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821821824:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185612.369971:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.369980:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.369987:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.370000:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.370006:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf5c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.370013:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.370020:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185612.370024:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.370032:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf5c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.370044:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a200) 00010000:00010000:3.0:1789185612.370060:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185612.370067:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf5c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.370074:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bf5c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.370086:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.370092:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.370098:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.370103:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185612.370106:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.370111:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.370118:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a200) 00010000:00010000:3.0:1789185612.370121:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789185612.370124:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.370129:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185612.370449:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:10475:x1876096812362240:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 21105us (21278us total) trans 4294967361 rc 0/0 00000100:00100000:3.0:1789185612.370467:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 83 00000020:00080000:3.0:1789185612.370473:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789185612.373001:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789185612.373014:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789185612.373048:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789185612.373055:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789185612.373476:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185612.373543:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812362752 00000100:00100000:0.0:1789185612.373552:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812362752 00000100:00100000:0.0:1789185612.373618:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:0.0:1789185612.373629:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:10475:x1876096812362752:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789185612.374297:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789185612.374445:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:0.0:1789185612.374495:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272bf63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.374511:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272bf63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.374524:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272bf63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.374540:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272bf63 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.374547:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272bf63 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.374553:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272bf63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185612.374578:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789185612.374684:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+17:10475:x1876096812362752:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 1054us (1211us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789185612.374693:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000020:00080000:0.0:1789185612.374698:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789185612.375050:0:11163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185612.375059:0:11163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272bf63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.375067:0:11163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355000 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185612.375072:0:11163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272bf63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.375080:0:11163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272bf63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.375095:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c79117a4e00) 00010000:00010000:3.0:1789185612.375098:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789185612.375105:0:11163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272bf63 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.375111:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272bf63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185612.375132:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185612.375133:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185612.375135:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185612.424902:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185612.424953:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185612.425083:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812363008 00000100:00100000:0.0:1789185612.425094:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812363008 00000100:00100000:0.0:1789185612.425181:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:0.0:1789185612.425194:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2371:x1876096812363008:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185612.425285:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2371:x1876096812363008:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 83us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185612.425292:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:2.0:1789185612.425947:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00080000:3.0:1789185612.427344:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185612.427835:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812363136 00000100:00100000:0.0:1789185612.427847:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812363136 00000100:00100000:0.0:1789185612.427920:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 138 00000100:00100000:0.0:1789185612.427930:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2371:x1876096812363136:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185612.428011:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2371:x1876096812363136:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 82us (2066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185612.428040:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 138 00000100:00080000:3.0:1789185612.428426:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185612.432178:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812362880 00000100:00100000:1.0:1789185612.432196:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812362880 00000100:00100000:0.0:1789185612.432388:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 288 00000100:00100000:0.0:1789185612.432398:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2371:x1876096812362880:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185612.432518:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2371:x1876096812362880:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 121us (7564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185612.432526:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 288 00010000:00010000:2.0:1789185612.950069:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185613.712714:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821821952:0@lo:400:kworker.0 00000100:00100000:2.0:1789185613.712795:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185613.712850:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821822464:0@lo:400:kworker.0 00000100:00100000:2.0:1789185613.712877:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185613.712906:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789185613.712913:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821822080:0@lo:400:kworker.0 00000100:00100000:2.0:1789185613.712945:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185613.712967:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78027db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821822592:0@lo:400:kworker.0 00000100:00100000:2.0:1789185613.712991:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185613.713025:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821822464 00000100:00100000:2.0:1789185613.713034:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821822464 00000100:00100000:2.0:1789185613.713093:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821822080 00000100:00100000:2.0:1789185613.713097:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821822080 00000100:00100000:2.0:1789185613.713118:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789185613.713126:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821822464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185613.713174:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821822464:12345-0@lo:400:kworker.0 Request processed in 48us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185613.713180:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789185613.713195:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789185613.713200:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821822080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185613.713225:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821822080:12345-0@lo:400:kworker.0 Request processed in 25us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185613.713238:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789185613.713259:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821822592 00000100:00100000:2.0:1789185613.713262:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821822592 00000100:00100000:2.0:1789185613.713300:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789185613.713307:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1876096821822592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185613.713341:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1876096821822592:12345-0@lo:400:kworker.0 Request processed in 34us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185613.713347:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789185613.713362:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185613.713398:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821822080:0@lo:400:kworker.0 00000100:00100000:2.0:1789185613.713441:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78027db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821822592:0@lo:400:kworker.0 00000100:00100000:2.0:1789185613.713451:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821822464:0@lo:400:kworker.0 00000100:00100000:0.0:1789185613.713616:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821821952 00000100:00100000:0.0:1789185613.713621:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821821952 00000100:00100000:0.0:1789185613.713659:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789185613.713666:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821821952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185613.713706:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821821952:12345-0@lo:400:kworker.0 Request processed in 40us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185613.713712:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789185613.714718:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821821952:0@lo:400:kworker.0 00000100:00100000:2.0:1789185613.714826:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821822336:0@lo:400:kworker.0 00000100:00100000:2.0:1789185613.714870:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185613.714907:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185613.714913:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821822208:0@lo:400:kworker.0 00000100:00100000:2.0:1789185613.714938:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185613.714972:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821822208 00000100:00100000:2.0:1789185613.714976:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821822208 00000100:00100000:2.0:1789185613.715017:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789185613.715025:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821822208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185613.715065:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821822208:12345-0@lo:400:kworker.0 Request processed in 40us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185613.715083:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1789185613.715106:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185613.715519:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821822336 00000100:00100000:0.0:1789185613.715524:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821822336 00000100:00100000:0.0:1789185613.715558:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789185613.715567:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3281:x1876096821822336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185613.715606:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3281:x1876096821822336:12345-0@lo:400:kworker.0 Request processed in 40us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185613.715612:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789185613.715741:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185613.715767:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821822208:0@lo:400:kworker.0 00000100:00100000:2.0:1789185613.715776:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821822336:0@lo:400:kworker.0 00000100:00100000:2.0:1789185613.717564:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821822720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185613.717639:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185613.717740:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821822720 00000100:00100000:3.0:1789185613.717747:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821822720 00000100:00100000:3.0:1789185613.717799:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789185613.717809:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876096821822720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185613.717855:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185613.717899:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876096821822720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185613.717907:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789185613.717995:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821822720:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789185613.946758:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789185613.946770:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789185613.946806:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789185613.946812:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789185613.968988:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185614.119208:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185614.119242:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812363392 00000100:00100000:3.0:1789185614.119250:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812363392 00000100:00100000:3.0:1789185614.120482:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:3.0:1789185614.120496:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+17:10494:x1876096812363392:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185614.120521:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185614.120541:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272bf6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d5bb expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.120655:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.120670:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.120684:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185614.120696:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789185614.120819:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272bf6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5bb expref: 20 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.120838:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5bb expref: 19 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.120859:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:3.0:1789185614.120862:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789185614.120865:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05c00, rc 0) 00000100:00100000:3.0:1789185614.120927:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:10494:x1876096812363392:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 434us (1730us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789185614.120935:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00080000:3.0:1789185614.120963:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185614.124832:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185614.124900:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812363520 00000100:00100000:2.0:1789185614.124913:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812363520 00000100:00100000:2.0:1789185614.124974:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:2.0:1789185614.124986:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:10494:x1876096812363520:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:2.0:1789185614.125072:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf7f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125091:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125104:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125121:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125129:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125136:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125536:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125547:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125554:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185614.125804:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125818:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125825:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125833:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125839:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185614.125843:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125851:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125863:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:2.0:1789185614.125866:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185614.125871:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125886:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bf7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125898:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125904:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125911:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125916:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185614.125920:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125927:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125934:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c792334a100) 00010000:00010000:2.0:1789185614.125937:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185614.125939:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125945:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125959:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125965:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125977:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125982:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185614.125985:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.125992:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.126000:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334ad00) 00010000:00010000:2.0:1789185614.126003:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185614.126006:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.126012:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185614.126098:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:10494:x1876096812363520:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 1113us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185614.126107:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:3.0:1789185614.174013:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185614.174113:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812363776 00000100:00100000:2.0:1789185614.174124:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812363776 00000100:00100000:2.0:1789185614.174183:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:2.0:1789185614.174193:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:10497:x1876096812363776:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185614.174216:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185614.174240:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d5c2 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174348:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174364:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174375:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174390:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174397:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174453:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174758:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bfa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174765:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bfa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174772:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bfa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185614.174782:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789185614.174885:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174903:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174911:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174917:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185614.174921:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174928:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174942:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:2.0:1789185614.174945:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185614.174951:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174957:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bf9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174970:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174977:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfa2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174983:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.174989:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185614.174999:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.175005:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.175012:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c792334ad00) 00010000:00010000:2.0:1789185614.175015:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185614.175018:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfa2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.175023:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.175069:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bf94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c2 expref: 22 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.175082:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bfa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c2 expref: 21 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.175088:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a100) 00010000:00010000:2.0:1789185614.175091:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185614.175093:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6200, rc 0) 00000100:00100000:2.0:1789185614.175157:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:10497:x1876096812363776:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 964us (1154us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789185614.175165:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:3.0:1789185614.180705:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185614.180826:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812363904 00000100:00100000:0.0:1789185614.180862:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812363904 00000100:00100000:0.0:1789185614.180921:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:0.0:1789185614.180932:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:10497:x1876096812363904:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:0.0:1789185614.181005:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bfb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.181022:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bfb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.181035:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bfb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.181064:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bfb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.181072:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bfb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.181079:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bfb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.181086:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185614.181090:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bfb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.181098:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bfb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.181110:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a100) 00010000:00010000:0.0:1789185614.181113:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789185614.181118:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bfb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.181135:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bfb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185614.181278:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:10497:x1876096812363904:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 346us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185614.181293:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:1.0:1789185614.187572:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185614.188152:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812364160 00000100:00100000:0.0:1789185614.188164:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812364160 00000100:00100000:0.0:1789185614.188253:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:0.0:1789185614.188274:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791916f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:10497:x1876096812364160:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:0.0:1789185614.188557:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791916f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+22:10497:x1876096812364160:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 284us (994us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1789185614.188566:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:3.0:1789185614.219116:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185614.219227:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812364416 00000100:00100000:2.0:1789185614.219239:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812364416 00000100:00100000:2.0:1789185614.219383:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:2.0:1789185614.219394:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+22:10015:x1876096812364416:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789185614.219471:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185614.219492:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bfbe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d5c9 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.219820:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.219838:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bfa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c2 expref: 23 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.219847:0:11024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.219882:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bfa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c2 expref: 23 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.219900:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bfa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c2 expref: 23 pid: 11024 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185614.219914:0:11024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78026a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1876096821822848:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185614.220112:0:11024:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee840 going to sleep for 11 seconds 00000100:00100000:1.0:1789185614.238847:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185614.238882:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812364544 00000100:00100000:1.0:1789185614.238893:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812364544 00010000:00010000:1.0:1789185614.238932:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bfa9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c2 expref: 24 pid: 11024 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185614.238970:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:1.0:1789185614.238980:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+24:2372:x1876096812364544:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185614.238995:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185614.239003:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bfa9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c2 expref: 24 pid: 11024 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.239037:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bfa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c2 expref: 24 pid: 11024 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.239062:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a100) 00010000:00010000:1.0:1789185614.239068:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.239078:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.239087:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.239108:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185614.239158:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+24:2372:x1876096812364544:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 180us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185614.239166:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00010000:00010000:3.0:1789185614.239458:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272bfa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c2 expref: 23 pid: 11024 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185614.239477:0:11024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78026a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1876096821822848:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185614.239500:0:11024:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.239511:0:11024:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.239518:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185614.239538:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789185614.239841:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bfbe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c9 expref: 24 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.239876:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c9 expref: 23 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.239885:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a100) 00010000:00010000:3.0:1789185614.239888:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789185614.239891:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7600, rc 0) 00000100:00100000:3.0:1789185614.239924:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+23:10015:x1876096812364416:12345-192.168.202.54@tcp:101:bash.0 Request processed in 20533us (20819us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789185614.239932:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:3.0:1789185614.246979:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185614.247029:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812364800 00000100:00100000:3.0:1789185614.247039:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812364800 00000100:00100000:3.0:1789185614.247102:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00100000:3.0:1789185614.247112:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+23:10015:x1876096812364800:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:3.0:1789185614.247432:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272bfd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.247449:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272bfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.247460:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272bfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789185614.247515:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:3.0:1789185614.247541:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b07c6aae reply state 00000000ec427b73 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272bfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185614.247569:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789185614.247620:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:3.0:1789185614.247731:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+27:10015:x1876096812364800:12345-192.168.202.54@tcp:36:bash.0 Request processed in 619us (762us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789185614.247739:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 89 00000020:00080000:3.0:1789185614.247744:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1789185614.250157:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272bfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.250174:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272bfd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.250181:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272bfd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.250186:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185614.250190:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272bfd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.250197:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272bfd3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.250236:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a100) 00010000:00010000:0.0:1789185614.250239:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185614.250246:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272bfd3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.250252:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272bfd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185614.251023:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185614.251512:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812364928 00000100:00100000:0.0:1789185614.251525:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812364928 00000100:00100000:0.0:1789185614.251583:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00100000:0.0:1789185614.251593:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:10015:x1876096812364928:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1789185614.251618:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185614.251648:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bfda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d5d0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.251710:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bfda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5d0 expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.251724:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bfda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5d0 expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.251743:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a100) 00010000:00010000:0.0:1789185614.251747:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789185614.251751:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355200, rc 0) 00000100:00100000:0.0:1789185614.251809:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+27:10015:x1876096812364928:12345-192.168.202.54@tcp:101:bash.0 Request processed in 217us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185614.251815:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00100000:3.0:1789185614.257039:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185614.257079:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812365056 00000100:00100000:3.0:1789185614.257089:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812365056 00000100:00100000:3.0:1789185614.257148:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:3.0:1789185614.257161:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:10015:x1876096812365056:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1789185614.257180:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185614.257203:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c46e77cf/0x532743011272bfe1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d5d7 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789185614.257229:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa4ce4a, atime: 0x6aa4ce48, ctime: 0x6aa4ce4a, blocks: 0xb 00010000:00010000:3.0:1789185614.257254:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=311s v=(0 0) 00010000:00010000:3.0:1789185614.257386:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185614.257399:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c46e77cf/0x532743011272bfe1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5d7 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.257446:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c46e77cf/0x532743011272bfe1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5d7 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.257460:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04800, rc 0) 00000100:00100000:3.0:1789185614.257528:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:10015:x1876096812365056:12345-192.168.202.54@tcp:101:bash.0 Request processed in 371us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185614.257535:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00080000:3.0:1789185614.257958:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185614.262784:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185614.262889:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812365184 00000100:00100000:1.0:1789185614.262901:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812365184 00002000:00010000:1.0:1789185614.262942:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789185614.262947:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7936cf1f80 with x1876096812365184 ext(0->18446744073709551615) 00002000:00010000:1.0:1789185614.262961:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7936cf1f80. 00000100:00100000:1.0:1789185614.262995:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:1.0:1789185614.263005:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2369:x1876096812365184:12345-192.168.202.54@tcp:10:bash.0 00002000:00010000:1.0:1789185614.263400:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789185614.263444:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789185610 -> 1789185613 00002000:00010000:1.0:1789185614.263447:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789185608 -> 1789185608 00002000:00010000:1.0:1789185614.263460:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789185610 -> 1789185613 00002000:00010000:1.0:1789185614.263463:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789185614.263518:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2369:x1876096812365184:12345-192.168.202.54@tcp:10:bash.0 Request processed in 514us (745us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789185614.263526:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00002000:00010000:1.0:1789185614.263530:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789185614.263532:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7936cf1f80 with x1876096812365184 ext(0->18446744073709551615) 00002000:00010000:1.0:1789185614.263537:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7936cf1f80. 00000001:00080000:0.0:1789185614.311734:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:0.0:1789185614.311758:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1789185614.338615:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185614.338773:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812365312 00000100:00100000:2.0:1789185614.338784:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812365312 00000100:00100000:2.0:1789185614.338848:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:2.0:1789185614.338856:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+27:10511:x1876096812365312:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:2.0:1789185614.338938:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bfe8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.338977:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bfe8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.338992:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bfe8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339009:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bfef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339014:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bfef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339019:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bfef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339223:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bff6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339230:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339235:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185614.339272:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339283:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bfe8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339289:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bfe8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339307:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bfe8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339313:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185614.339317:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bfe8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339325:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bfe8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339339:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:2.0:1789185614.339342:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185614.339348:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bfe8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339353:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272bfe8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339364:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bfef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339368:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bfef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339372:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bfef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339374:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185614.339376:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bfef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339387:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bfef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339392:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c792334ad00) 00010000:00010000:2.0:1789185614.339393:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185614.339395:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bfef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339399:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272bfef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339797:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339803:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bff6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339807:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339810:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185614.339812:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339815:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bff6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339821:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a100) 00010000:00010000:2.0:1789185614.339822:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185614.339825:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bff6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.339837:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272bff6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185614.339988:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+27:10511:x1876096812365312:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 1128us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185614.339997:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:3.0:1789185614.394044:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185614.394195:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812365568 00000100:00100000:0.0:1789185614.394205:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812365568 00000100:00100000:0.0:1789185614.394257:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00100000:0.0:1789185614.394266:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+27:10514:x1876096812365568:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789185614.394298:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185614.394320:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bffd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d5de expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.394390:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c004 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.394443:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c004 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.394452:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c004 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.394464:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c00b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.394468:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c00b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.394473:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c00b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.394751:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c012 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.394761:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.394772:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185614.394785:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789185614.394882:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c004 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.394890:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c004 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.394898:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c004 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.394904:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185614.394908:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c004 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.394916:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c004 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.395129:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:0.0:1789185614.395133:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185614.395140:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c004 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.395157:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c004 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.395170:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c00b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.395176:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c00b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.395183:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c00b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.395188:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185614.395190:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c00b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.395197:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c00b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.395204:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c79117a4000) 00010000:00010000:0.0:1789185614.395207:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185614.395210:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c00b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.395216:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c00b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.395361:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272bffd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5de expref: 30 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.395381:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c012 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5de expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.395389:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a100) 00010000:00010000:2.0:1789185614.395391:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789185614.395394:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355600, rc 0) 00000100:00100000:2.0:1789185614.395695:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+29:10514:x1876096812365568:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1428us (1663us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789185614.395704:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00100000:1.0:1789185614.401820:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185614.401886:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812365696 00000100:00100000:3.0:1789185614.401896:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812365696 00000100:00100000:3.0:1789185614.401959:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:3.0:1789185614.401966:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+29:10514:x1876096812365696:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:3.0:1789185614.402038:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c020 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.402057:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c9 expref: 29 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.402067:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c020 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.402105:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c9 expref: 29 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.402121:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c9 expref: 29 pid: 11024 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185614.402134:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821822976:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185614.402234:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b519c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185614.407767:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185614.407881:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812365952 00000100:00100000:2.0:1789185614.407891:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812365952 00000100:00100000:2.0:1789185614.407967:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:2.0:1789185614.407979:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+30:5611:x1876096812365952:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789185614.408388:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+31:5611:x1876096812365952:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 405us (625us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789185614.408395:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:0.0:1789185614.409298:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821822976:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185614.409329:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c020 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789185614.417093:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789185614.417103:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789185614.417136:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789185614.417142:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789185614.419744:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185614.419934:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812366080 00000100:00100000:0.0:1789185614.419948:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812366080 00010000:00010000:0.0:1789185614.419997:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c9 expref: 31 pid: 11024 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185614.420046:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:0.0:1789185614.420057:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+31:2371:x1876096812366080:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185614.420075:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185614.420082:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c9 expref: 31 pid: 11024 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.420098:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c9 expref: 31 pid: 11024 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.420126:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272bfc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5c9 expref: 31 pid: 11024 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.420143:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a100) 00010000:00010000:0.0:1789185614.420149:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c020 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.420160:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c020 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.420189:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c020 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.420228:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185614.420446:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c020 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.420455:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c020 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.420489:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c020 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.420497:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c020 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.420504:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c020 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.420509:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185614.420514:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c020 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.420522:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c020 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.420531:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a100) 00010000:00010000:3.0:1789185614.420534:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185614.420538:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c020 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.420545:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c020 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185614.420692:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+30:2371:x1876096812366080:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 635us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185614.420701:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:3.0:1789185614.422791:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+29:10514:x1876096812365696:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 20812us (20970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185614.422822:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:1.0:1789185614.426296:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185614.428052:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812366336 00000100:00100000:2.0:1789185614.428067:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812366336 00000100:00100000:2.0:1789185614.428146:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:2.0:1789185614.428157:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+29:10514:x1876096812366336:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789185614.428679:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+30:10514:x1876096812366336:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 521us (2393us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789185614.428688:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1789185614.553645:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185614.553932:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812366592 00000100:00100000:3.0:1789185614.553949:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812366592 00000100:00100000:3.0:1789185614.554047:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:3.0:1789185614.554061:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+30:10525:x1876096812366592:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:3.0:1789185614.554105:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185614.554139:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c027 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d5e5 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.554274:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c02e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.554771:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c02e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.554790:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c02e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.554812:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c035 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.554819:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.554827:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.555228:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c03c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.555266:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c03c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.555276:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c03c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185614.556918:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789185614.559977:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c02e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.560005:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c02e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.560015:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c02e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.560023:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185614.560029:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c02e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.560038:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c02e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.560063:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:3.0:1789185614.560066:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185614.560074:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c02e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.560081:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c02e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.560102:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.560130:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c035 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.560137:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c035 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.560142:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185614.560146:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c035 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.560152:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c035 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.560160:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c79055dd100) 00010000:00010000:3.0:1789185614.560163:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185614.560166:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c035 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.560172:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c035 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.560260:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c027 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5e5 expref: 33 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.562800:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c03c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5e5 expref: 32 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.562838:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a100) 00010000:00010000:3.0:1789185614.562842:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185614.562881:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05000, rc 0) 00000100:00100000:3.0:1789185614.563060:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:10525:x1876096812366592:12345-192.168.202.54@tcp:101:cat.0 Request processed in 8995us (9756us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789185614.563073:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:1.0:1789185614.574872:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185614.574962:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812366848 00000100:00100000:3.0:1789185614.574972:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812366848 00000100:00100000:3.0:1789185614.575120:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:3.0:1789185614.575134:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:10525:x1876096812366848:12345-192.168.202.54@tcp:35:cat.0 00000100:00100000:3.0:1789185614.575681:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+33:10525:x1876096812366848:12345-192.168.202.54@tcp:35:cat.0 Request processed in 550us (818us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789185614.575692:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:1.0:1789185614.601385:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185614.601587:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812367104 00000100:00100000:0.0:1789185614.601601:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812367104 00000100:00100000:0.0:1789185614.601671:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:0.0:1789185614.601684:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+33:10526:x1876096812367104:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:0.0:1789185614.601750:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789185614.601779:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c03c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5e5 expref: 33 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.601804:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c012 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5de expref: 32 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.601817:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272bfda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5d0 expref: 31 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.601826:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c792334a100) 00010000:00010000:0.0:1789185614.601840:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185614.601869:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c04a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.601884:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c04a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.601915:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c04a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.601931:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c051 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.601939:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.601946:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.602221:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c058 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.602230:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c058 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.602237:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c058 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789185614.602867:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1789185614.602879:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 311642472702ns, next at 312642470051ns, rc = 0 00010000:00010000:0.0:1789185614.602943:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c05f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.602954:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c05f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.602962:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c05f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.602981:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c05f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.602988:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c05f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.602995:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c05f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.603027:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185614.603049:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c058 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.603056:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c058 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.603062:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c058 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.603068:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185614.603072:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c058 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.603079:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c058 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.603090:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c79117a4100) 00010000:00010000:0.0:1789185614.603094:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789185614.603098:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c058 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.603114:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c058 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.603133:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c04a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.603140:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c04a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.603146:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c04a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.603152:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185614.603155:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c04a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.603162:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c04a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.603172:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:0.0:1789185614.603174:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185614.603177:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c04a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.603182:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c04a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789185614.603192:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f0103f47 reply state 00000000e098fa52 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185614.603200:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789185614.603304:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:10526:x1876096812367104:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1620us (1927us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789185614.603313:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 95 00010000:00010000:1.0:1789185614.603730:0:11163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185614.603740:0:11163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c05f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.603747:0:11163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354000 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185614.603751:0:11163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c05f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.603759:0:11163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c05f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.603769:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c79117a4100) 00010000:00010000:1.0:1789185614.603771:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789185614.603774:0:11163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c05f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.603791:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c05f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.603808:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185614.603810:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185614.603812:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185614.607243:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.607273:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c051 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.607282:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c051 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.607289:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185614.607294:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c051 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.607303:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c051 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.607321:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c79117a4000) 00010000:00010000:3.0:1789185614.607324:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185614.607358:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c051 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.607365:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c051 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185614.651248:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185614.651380:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812367360 00000100:00100000:2.0:1789185614.651390:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812367360 00000100:00100000:2.0:1789185614.651469:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 96 00000100:00100000:2.0:1789185614.651479:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+31:10532:x1876096812367360:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789185614.651506:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185614.651539:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c066 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d5ec expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.651686:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c06d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.651701:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c06d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.651712:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c06d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.651725:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c074 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.651732:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.651737:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789185614.652280:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789185614.652483:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c07b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.652495:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c07b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.652503:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c07b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.652539:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c06d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.652547:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c06d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.652554:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c06d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.652562:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185614.652566:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c06d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.652573:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c06d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.652585:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:2.0:1789185614.652588:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185614.652594:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c06d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.652600:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c06d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185614.652637:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fe57cc95 reply state 000000003f1d2677 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185614.652646:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789185614.652677:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c066 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ec expref: 34 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.652693:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c07b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ec expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.652699:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334aa00) 00010000:00010000:2.0:1789185614.652702:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185614.652704:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7000, rc 0) 00000100:00100000:2.0:1789185614.652796:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+34:10532:x1876096812367360:12345-192.168.202.54@tcp:101:bash.0 Request processed in 1317us (1557us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789185614.652806:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 96 00010000:00010000:0.0:1789185614.658752:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.658770:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c074 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.658778:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c074 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.658785:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185614.658790:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c074 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.658798:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c074 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.658816:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c792334ad00) 00010000:00010000:0.0:1789185614.658819:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185614.658825:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c074 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.658832:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c074 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185614.659956:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185614.660899:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812367488 00000100:00100000:0.0:1789185614.660913:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812367488 00000100:00100000:0.0:1789185614.661052:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:0.0:1789185614.661064:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812367488:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1789185614.661101:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185614.661123:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da4a67c7/0x532743011272c089 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d5f3 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789185614.661151:0:6884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789185614.661171:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=311s v=(0 0) 00010000:00010000:0.0:1789185614.661177:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185614.661187:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da4a67c7/0x532743011272c089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5f3 expref: 6 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.661208:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da4a67c7/0x532743011272c089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5f3 expref: 6 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.661223:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355000, rc 0) 00000100:00100000:0.0:1789185614.661660:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812367488:12345-192.168.202.54@tcp:101:bash.0 Request processed in 594us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185614.661669:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00080000:3.0:1789185614.661737:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185614.674847:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185614.674961:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812367616 00000100:00100000:3.0:1789185614.674971:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812367616 00000100:00100000:3.0:1789185614.675036:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:3.0:1789185614.675059:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:10532:x1876096812367616:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1789185614.675081:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185614.675103:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d5fa expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.675138:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da4a67c7/0x532743011272c089 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5f3 expref: 7 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.675149:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185614.675154:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185614.675160:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.675201:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000da4a67c7/0x532743011272c089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5f3 expref: 7 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.675221:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000da4a67c7/0x532743011272c089 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5f3 expref: 7 pid: 6884 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185614.675391:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1876096821823104:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185614.675705:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b51180 going to sleep for 11 seconds 00000100:00100000:3.0:1789185614.680740:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1876096821823104:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185614.680780:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.680803:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05200, rc 0) 00000100:00100000:3.0:1789185614.680869:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:10532:x1876096812367616:12345-192.168.202.54@tcp:101:bash.0 Request processed in 5822us (6032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185614.680878:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:1.0:1789185614.686839:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185614.689189:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812367744 00000100:00100000:2.0:1789185614.689205:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812367744 00010000:00010000:2.0:1789185614.689319:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000da4a67c7/0x532743011272c089 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5f3 expref: 7 pid: 6884 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185614.689476:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:2.0:1789185614.689488:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791f907450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2371:x1876096812367744:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185614.689507:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185614.689542:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000da4a67c7/0x532743011272c089 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5f3 expref: 7 pid: 6884 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.689581:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000da4a67c7/0x532743011272c089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5f3 expref: 7 pid: 6884 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.689609:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da4a67c7/0x532743011272c089 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5f3 expref: 7 pid: 6884 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.689636:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185614.689642:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185614.689650:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.689660:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.689703:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185614.689721:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78026a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5809:1876096821823232:192.168.202.54@tcp:105: 00000100:00100000:2.0:1789185614.689824:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031eeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185614.695285:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185614.695764:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812368000 00000100:00100000:3.0:1789185614.695774:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812368000 00000100:00100000:3.0:1789185614.695834:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:3.0:1789185614.695846:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+33:10532:x1876096812368000:12345-192.168.202.54@tcp:35:bash.0 00000001:00080000:3.0:1789185614.696163:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967378 00000100:00100000:3.0:1789185614.696287:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:10532:x1876096812368000:12345-192.168.202.54@tcp:35:bash.0 Request processed in 443us (1011us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789185614.696295:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000020:00080000:3.0:1789185614.696300:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789185614.700014:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78026a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5809:1876096821823232:192.168.202.54@tcp:105: 00010000:00010000:2.0:1789185614.700046:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185614.700827:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791f907450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2371:x1876096812367744:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 11335us (13992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185614.700842:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:0.0:1789185614.735931:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185614.735957:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821823360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185614.736032:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185614.736243:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821823360 00000100:00100000:3.0:1789185614.736252:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821823360 00000100:00100000:3.0:1789185614.736381:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789185614.736391:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821823360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185614.736491:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185614.736740:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821823360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 350us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185614.736748:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789185614.740437:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1789185614.740449:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1789185614.740472:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7936b5d880, transno 4294967301 00000100:00100000:0.0:1789185614.740648:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821823360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185614.904289:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185614.904709:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812368128 00000100:00100000:0.0:1789185614.904720:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812368128 00000100:00100000:0.0:1789185614.904798:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:0.0:1789185614.904814:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:10548:x1876096812368128:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789185614.904846:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185614.904868:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c097 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d601 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.905233:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272c09e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.905248:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272c09e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.905260:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272c09e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185614.905299:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789185614.905304:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185614.905322:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272c09e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.905347:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c097 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d601 expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.905365:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272c09e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d601 expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.905373:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:0.0:1789185614.905375:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185614.905379:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355200, rc 0) 00000100:00100000:0.0:1789185614.905509:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:10548:x1876096812368128:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 701us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185614.905523:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:2.0:1789185614.911714:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185614.911779:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812368384 00000100:00100000:3.0:1789185614.911793:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812368384 00000100:00100000:3.0:1789185614.911861:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:3.0:1789185614.911871:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:10548:x1876096812368384:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185614.911893:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185614.911915:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c0a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d608 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.912020:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c0ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.912035:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c0ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.912048:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c0ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185614.912059:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789185614.912190:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c0a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d608 expref: 39 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.912207:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c0ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d608 expref: 38 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.912216:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334aa00) 00010000:00010000:3.0:1789185614.912219:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185614.912238:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05400, rc 0) 00000100:00100000:3.0:1789185614.912316:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:10548:x1876096812368384:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 446us (613us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1789185614.912324:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:1.0:1789185614.921154:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185614.921200:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185614.921293:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812368768 00000100:00100000:2.0:1789185614.921305:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812368768 00000100:00100000:2.0:1789185614.921380:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:2.0:1789185614.921390:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:2369:x1876096812368768:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185614.921426:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185614.921454:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c0ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d608 expref: 38 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.921478:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334aa00) 00010000:00010000:2.0:1789185614.921484:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185614.921563:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+37:2369:x1876096812368768:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 174us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185614.921571:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:3.0:1789185614.921900:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812368640 00000100:00100000:3.0:1789185614.921906:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812368640 00000100:00100000:3.0:1789185614.921946:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:3.0:1789185614.921955:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+37:10548:x1876096812368640:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185614.921976:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185614.921995:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c0ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d60f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.922095:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c0c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.922111:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c0c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.922123:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c0c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185614.922136:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789185614.922278:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c0ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d60f expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.922293:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c0c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d60f expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.922300:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334aa00) 00010000:00010000:3.0:1789185614.922316:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789185614.922319:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04400, rc 0) 00000100:00100000:3.0:1789185614.922365:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+39:10548:x1876096812368640:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 411us (1222us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1789185614.922371:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:1.0:1789185614.928580:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185614.928721:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812368896 00000100:00100000:0.0:1789185614.928732:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812368896 00000100:00100000:0.0:1789185614.928795:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:0.0:1789185614.928805:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812368896:12345-192.168.202.54@tcp:1:lfs.0 00010000:00010000:0.0:1789185614.928852:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c0cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.928874:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.928882:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185614.928887:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789185614.928891:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c0cf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.928928:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.928946:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 6 pid: 6679 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185614.928960:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78027d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1876096821823488:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789185614.929060:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7929b2d840 going to sleep for 11 seconds 00000100:00100000:0.0:1789185614.932177:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78027d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1876096821823488:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185614.932229:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c0cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185614.935363:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185614.935741:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812369024 00000100:00100000:3.0:1789185614.935751:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812369024 00002000:00100000:3.0:1789185614.935804:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9c7904d7f800 x1876096812369024/t0(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:215/0 lens 504/0 e 0 to 0 dl 1789185625 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789185614.935816:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7904d7f800 with x1876096812369024 ext(0->8) 00010000:00010000:3.0:1789185614.935826:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 7 pid: 6679 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185614.935847:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 7 pid: 6679 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789185614.935855:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c7904d7f800 00000100:00100000:3.0:1789185614.935894:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:3.0:1789185614.935905:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2372:x1876096812369024:12345-192.168.202.54@tcp:4:lfs.0 00000100:00100000:2.0:1789185614.937813:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2372:x1876096812369024:12345-192.168.202.54@tcp:4:lfs.0 Request processed in 1901us (2452us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789185614.937826:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00002000:00100000:2.0:1789185614.937838:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9c7904d7f800 x1876096812369024/t4294967302(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:215/0 lens 504/448 e 0 to 0 dl 1789185625 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185614.937846:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7904d7f800 with x1876096812369024 ext(0->8) 00010000:00010000:2.0:1789185614.937868:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 9 pid: 6679 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.937890:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 9 pid: 6679 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789185614.937911:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c7904d7f800 00000100:00100000:1.0:1789185614.941475:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185614.941732:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812369152 00000100:00100000:2.0:1789185614.941742:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812369152 00010000:00010000:2.0:1789185614.941783:0:6692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 9 pid: 6679 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185614.941878:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:2.0:1789185614.941889:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2369:x1876096812369152:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185614.941905:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789185614.941926:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789185614.941929:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789185614 00002000:00010000:2.0:1789185614.941932:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789185614 00002000:00010000:2.0:1789185614.941934:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789185614 00010000:00010000:2.0:1789185614.941940:0:6692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 9 pid: 6679 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.941957:0:6692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 9 pid: 6679 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.941982:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecb1a96d/0x532743011272c090 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5fa expref: 9 pid: 6679 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.942001:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185614.942006:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185614.942012:0:6692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c0cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.942037:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c0cf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.942077:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185614.942144:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2369:x1876096812369152:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 256us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185614.942152:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 50 00010000:00010000:0.0:1789185614.942457:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c0cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.942467:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c0cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.942499:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c0cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.942508:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c0cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.942528:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c0cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.942536:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355600 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185614.942540:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c0cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.942549:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c0cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.942569:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c0cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.942587:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c0cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185614.942662:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2372:x1876096812368896:12345-192.168.202.54@tcp:1:lfs.0 Request processed in 13858us (14092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185614.942669:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:3.0:1789185614.949006:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185614.949158:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812369408 00000100:00100000:0.0:1789185614.949171:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812369408 00000100:00100000:0.0:1789185614.949232:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:0.0:1789185614.949242:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791916d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+39:10548:x1876096812369408:12345-192.168.202.54@tcp:35:lfs.0 00000004:00010000:0.0:1789185614.949327:0:5825:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c0c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d60f expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789185614.949688:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1789185614.949737:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789185614.950107:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1789185614.950164:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c0d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.950179:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c07b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ec expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.950189:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c0d6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.950225:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c07b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ec expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.950256:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c07b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ec expref: 43 pid: 5824 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185614.950272:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78027d9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1876096821823616:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789185614.950364:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7929b2d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789185614.954745:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185614.954828:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812369536 00000100:00100000:1.0:1789185614.954840:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812369536 00010000:00010000:1.0:1789185614.954883:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c07b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ec expref: 44 pid: 5824 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185614.954955:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:1.0:1789185614.954966:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+44:2371:x1876096812369536:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185614.954986:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185614.954994:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c07b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ec expref: 44 pid: 5824 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185614.955011:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78027d9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1876096821823616:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185614.955038:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c0d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.955051:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c07b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ec expref: 44 pid: 5824 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.955075:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c07b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5ec expref: 44 pid: 5824 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.955090:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334aa00) 00010000:00010000:1.0:1789185614.955095:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c0d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.955104:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c0d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.955118:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c0d6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.955141:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185614.955147:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c0d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185614.955157:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c0d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185614.955202:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+43:2371:x1876096812369536:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 236us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185614.955209:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000001:00080000:0.0:1789185614.956707:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1789185614.964520:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1789185614.964756:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78027d9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1876096821823744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789185614.964826:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185614.965203:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7929b2d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789185614.965245:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821823744 00000100:00100000:3.0:1789185614.965374:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821823744 00000100:00100000:3.0:1789185614.965553:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789185614.965566:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1876096821823744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789185614.965678:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1876096821823744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185614.965695:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789185614.965770:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78027d9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1876096821823744:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789185614.966608:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1789185614.966697:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d7c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1876096821823872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789185614.966741:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185614.968675:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7908684f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789185614.968736:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821823872 00000100:00100000:0.0:1789185614.968747:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821823872 00000100:00100000:0.0:1789185614.968804:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185614.968815:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1876096821823872:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789185614.969173:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5825:x1876096821823872:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 359us (2431us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789185614.969195:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185614.969499:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d7c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1876096821823872:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789185614.969578:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789185614.969639:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c0d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.969651:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c0d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.969661:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c0d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.969667:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185614.969672:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c0d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.969681:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c0d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.969701:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334aa00) 00010000:00010000:1.0:1789185614.969705:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789185614.969711:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c0d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185614.969717:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c0d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789185614.970168:0:5825:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789185614.970380:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1789185614.970393:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 312009986749ns, next at 313009984075ns, rc = 0 00000001:00080000:1.0:1789185614.970400:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1789185614.970462:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334aa00) 00010000:00010000:1.0:1789185614.970466:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789185614.970481:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c0c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d60f expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185614.970592:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791916d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+46:10548:x1876096812369408:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 21349us (21596us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789185614.970602:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000020:00080000:1.0:1789185614.970606:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789185614.972950:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185614.973127:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812369664 00000100:00100000:2.0:1789185614.973137:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812369664 00000100:00100000:2.0:1789185614.973230:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00100000:2.0:1789185614.973241:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+46:10548:x1876096812369664:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185614.973275:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185614.973299:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c0dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d616 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.973356:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c0dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d616 expref: 47 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.973371:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c0dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d616 expref: 47 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185614.973390:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:2.0:1789185614.973393:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185614.973397:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6a00, rc 0) 00000100:00100000:2.0:1789185614.973494:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+47:10548:x1876096812369664:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 254us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185614.973526:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00100000:0.0:1789185614.980734:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185614.980869:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812369920 00000100:00100000:3.0:1789185614.980879:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812369920 00000100:00100000:3.0:1789185614.980937:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:3.0:1789185614.980947:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+47:10548:x1876096812369920:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789185614.981198:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+48:10548:x1876096812369920:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 251us (473us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789185614.981206:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 27 00010000:00010000:2.0:1789185614.991883:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185615.108533:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185615.108640:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812370048 00000100:00100000:3.0:1789185615.108652:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812370048 00000100:00100000:3.0:1789185615.108715:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:3.0:1789185615.108725:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+48:10558:x1876096812370048:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:3.0:1789185615.108810:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c0e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.108828:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c0e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.108840:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c0e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.108856:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c0eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.108863:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c0eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.108870:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c0eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.108979:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c0f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.108989:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.108996:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185615.109036:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109048:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c0e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109320:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c0e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109329:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c0e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109336:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185615.109340:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c0e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109348:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c0e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109361:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:3.0:1789185615.109364:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185615.109370:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c0e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109382:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c0e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109397:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c0eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109446:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c0eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109452:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c0eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109457:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185615.109460:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c0eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109465:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c0eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109473:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c79055dd100) 00010000:00010000:3.0:1789185615.109475:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185615.109478:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c0eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109483:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c0eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109500:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109507:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c0f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109520:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109525:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185615.109528:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109535:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c0f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109543:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:3.0:1789185615.109545:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185615.109548:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c0f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.109555:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c0f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185615.110533:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+48:10558:x1876096812370048:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 1803us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185615.110545:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:0.0:1789185615.173475:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185615.174245:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812370304 00000100:00100000:3.0:1789185615.174267:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812370304 00000100:00100000:3.0:1789185615.174487:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:3.0:1789185615.174498:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+48:10561:x1876096812370304:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185615.174519:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185615.174543:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c0f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d61d expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.174692:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c100 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.174710:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c100 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.174724:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c100 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.174741:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c107 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.174747:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.174755:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.174904:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c10e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.174913:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c10e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.174921:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c10e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185615.174931:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789185615.175042:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c100 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175060:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c100 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175067:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c100 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175074:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185615.175078:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c100 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175086:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c100 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175100:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:3.0:1789185615.175103:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185615.175107:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c100 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175113:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c100 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175127:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175133:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c107 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175139:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c107 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175144:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185615.175152:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c107 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175158:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c107 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175165:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c79055dd100) 00010000:00010000:3.0:1789185615.175167:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185615.175170:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c107 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175175:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c107 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175220:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c0f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d61d expref: 51 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175234:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c10e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d61d expref: 50 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.175242:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:3.0:1789185615.175244:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185615.175247:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04e00, rc 0) 00000100:00100000:3.0:1789185615.175940:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+50:10561:x1876096812370304:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1441us (2473us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789185615.175948:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:2.0:1789185615.179166:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185615.179302:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812370432 00000100:00100000:0.0:1789185615.179311:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812370432 00000100:00100000:0.0:1789185615.179374:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:0.0:1789185615.179386:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+50:10561:x1876096812370432:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:0.0:1789185615.179498:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c11c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.179515:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c11c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.179527:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c11c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.179553:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c11c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.179573:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c11c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.179580:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c11c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.179587:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185615.179592:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c11c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.179629:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c11c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.179645:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:0.0:1789185615.179648:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789185615.179654:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c11c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.179660:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c11c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185615.179739:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+50:10561:x1876096812370432:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 354us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185615.179746:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:0.0:1789185615.182046:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185615.186979:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812370688 00000100:00100000:3.0:1789185615.186995:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812370688 00000100:00100000:3.0:1789185615.187050:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:3.0:1789185615.187059:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+50:10561:x1876096812370688:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789185615.187598:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+51:10561:x1876096812370688:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 537us (5561us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1789185615.187606:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:2.0:1789185615.298219:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185615.298301:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812370944 00000100:00100000:3.0:1789185615.298312:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812370944 00000100:00100000:3.0:1789185615.298465:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:3.0:1789185615.298486:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+51:10571:x1876096812370944:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1789185615.298526:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185615.298529:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789185615.298555:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272c09e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d601 expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.298575:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:3.0:1789185615.298580:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185615.298594:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c123 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d624 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.298708:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c12a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.298723:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c12a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.298733:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c12a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185615.298744:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789185615.298871:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c123 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d624 expref: 53 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.298902:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c12a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d624 expref: 52 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.298910:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:3.0:1789185615.298913:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185615.298916:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04200, rc 0) 00000100:00100000:3.0:1789185615.298980:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+52:10571:x1876096812370944:12345-192.168.202.54@tcp:101:bash.0 Request processed in 499us (771us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789185615.298987:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:2.0:1789185615.308161:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185615.308371:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812371072 00000100:00100000:1.0:1789185615.308381:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812371072 00000100:00100000:1.0:1789185615.308468:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:1.0:1789185615.308481:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+52:2372:x1876096812371072:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185615.308497:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185615.308522:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c12a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d624 expref: 52 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185615.308542:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:1.0:1789185615.308548:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185615.308623:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+51:2372:x1876096812371072:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 136us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185615.308630:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1789185615.315915:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185615.316088:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812371328 00000100:00100000:3.0:1789185615.316100:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812371328 00000100:00100000:3.0:1789185615.316160:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 105 00000100:00100000:3.0:1789185615.316171:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+51:10571:x1876096812371328:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:3.0:1789185615.316242:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185615.317004:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c10e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d61d expref: 51 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.317025:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:3.0:1789185615.317031:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185615.320036:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c138 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.320064:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c138 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.320079:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c138 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789185615.320226:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1789185615.320289:0:5822:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009a4ef2a1 reply state 00000000acbe8bfb transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c138 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185615.320299:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789185615.320444:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+53:10571:x1876096812371328:12345-192.168.202.54@tcp:36:bash.0 Request processed in 4272us (4536us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789185615.320454:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 105 00000020:00080000:3.0:1789185615.320460:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789185615.325215:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c138 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.325235:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c138 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.325243:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c138 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.325250:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185615.325255:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c138 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.325279:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c138 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.325311:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:0.0:1789185615.325314:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185615.325319:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c138 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.325325:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c138 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185615.336178:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185615.336351:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812371456 00000100:00100000:2.0:1789185615.336364:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812371456 00000100:00100000:2.0:1789185615.336459:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:2.0:1789185615.336482:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+52:10571:x1876096812371456:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789185615.336524:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185615.336548:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c13f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d62b expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185615.336644:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c146 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185615.336660:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185615.336671:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185615.337838:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789185615.337849:0:11024:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789185615.337882:0:11024:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185615.337930:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c13f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d62b expref: 54 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185615.337980:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c146 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d62b expref: 53 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185615.337990:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:2.0:1789185615.337994:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185615.337999:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6200, rc 0) 00000100:00100000:2.0:1789185615.338090:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+53:10571:x1876096812371456:12345-192.168.202.54@tcp:101:bash.0 Request processed in 1620us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185615.338100:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:3.0:1789185615.354385:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185615.354507:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812371712 00000100:00100000:1.0:1789185615.354518:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812371712 00000100:00100000:1.0:1789185615.354580:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:1.0:1789185615.354591:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+53:10571:x1876096812371712:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:1.0:1789185615.354876:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+54:10571:x1876096812371712:12345-192.168.202.54@tcp:35:bash.0 Request processed in 286us (502us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1789185615.354893:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:0.0:1789185615.442699:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185615.442784:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812371840 00000100:00100000:3.0:1789185615.442794:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812371840 00000100:00100000:0.0:1789185615.442935:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 107 00000100:00100000:0.0:1789185615.442947:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+54:10577:x1876096812371840:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789185615.442973:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185615.442995:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c14d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d632 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.443061:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c154 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.443075:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.443087:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185615.443120:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789185615.443125:0:5822:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185615.443145:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.443171:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c14d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d632 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.443204:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c154 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d632 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.443212:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:0.0:1789185615.443215:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185615.443219:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354600, rc 0) 00000100:00100000:0.0:1789185615.443295:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+55:10577:x1876096812371840:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 350us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185615.443302:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 107 00000100:00100000:2.0:1789185615.448088:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185615.448713:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812371968 00000100:00100000:3.0:1789185615.448724:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812371968 00000100:00100000:3.0:1789185615.448787:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:3.0:1789185615.448799:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+55:10577:x1876096812371968:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185615.448822:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185615.449056:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c15b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d639 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449165:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c162 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449179:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c162 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449191:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c162 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449217:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c169 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449225:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449232:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449353:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c170 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449364:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449371:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185615.449444:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789185615.449449:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789185615.449541:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449555:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449563:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c162 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449570:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c162 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449587:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c162 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449593:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185615.449597:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c162 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449605:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c162 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449628:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:3.0:1789185615.449631:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185615.449636:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c162 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449643:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c162 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449657:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449663:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c169 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449669:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c169 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449674:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185615.449676:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c169 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449693:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c169 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449701:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c79055dd100) 00010000:00010000:3.0:1789185615.449703:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185615.449706:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c169 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449712:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c169 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449747:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c15b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d639 expref: 57 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449761:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c170 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d639 expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.449768:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:3.0:1789185615.449770:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185615.449773:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04200, rc 0) 00000100:00100000:3.0:1789185615.449923:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+56:10577:x1876096812371968:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1126us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185615.449930:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:0.0:1789185615.461543:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185615.461688:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812372224 00000100:00100000:3.0:1789185615.461700:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812372224 00000100:00100000:3.0:1789185615.461768:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:3.0:1789185615.461779:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+56:10577:x1876096812372224:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185615.461820:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185615.461852:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c177 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d640 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.461972:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.461990:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c146 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d62b expref: 57 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.461999:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c170 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d639 expref: 57 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.462008:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.462047:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c170 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d639 expref: 57 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.462067:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c170 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d639 expref: 57 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185615.462079:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821824000:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185615.462190:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c146 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d62b expref: 57 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.462200:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c146 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d62b expref: 57 pid: 11024 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185615.462221:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821824128:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185615.462248:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b51900 going to sleep for 11 seconds 00000100:00100000:0.0:1789185615.464903:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185615.465014:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812372352 00000100:00100000:2.0:1789185615.465025:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812372352 00010000:00010000:2.0:1789185615.465074:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c170 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d639 expref: 58 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185615.465121:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:2.0:1789185615.465132:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+58:2369:x1876096812372352:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185615.465149:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185615.465156:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c170 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d639 expref: 58 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185615.465174:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c170 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d639 expref: 58 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185615.465199:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:2.0:1789185615.465218:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185615.465228:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185615.465235:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185615.465297:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+58:2369:x1876096812372352:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 167us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185615.465305:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00010000:00010000:3.0:1789185615.469264:0:5822:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.54@tcp) returned -22 from blocking AST (req@00000000f581d1db x1876096821824000) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c170 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d639 expref: 57 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.469290:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c170 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d639 expref: 57 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185615.469309:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821824000:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185615.469324:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821824128:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185615.469351:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:3.0:1789185615.469356:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.469365:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.469374:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185615.477192:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185615.479153:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812372480 00000100:00100000:1.0:1789185615.479168:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812372480 00010000:00010000:1.0:1789185615.479217:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c146 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d62b expref: 57 pid: 11024 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185615.479265:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:1.0:1789185615.479274:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+57:2372:x1876096812372480:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185615.479289:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185615.479297:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c146 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d62b expref: 57 pid: 11024 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185615.479314:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c146 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d62b expref: 57 pid: 11024 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185615.479338:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c146 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d62b expref: 57 pid: 11024 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185615.479356:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:1.0:1789185615.479362:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185615.479372:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185615.479380:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185615.479446:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185615.479515:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+56:2372:x1876096812372480:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 242us (2334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185615.479523:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00010000:00010000:3.0:1789185615.479830:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.479838:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185615.479881:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789185615.480025:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c177 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d640 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.480042:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d640 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185615.480049:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:3.0:1789185615.480051:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789185615.480054:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05a00, rc 0) 00000100:00100000:3.0:1789185615.480095:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+56:10577:x1876096812372224:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 18314us (18559us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1789185615.480101:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:0.0:1789185615.488372:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185615.488529:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812372736 00000100:00100000:2.0:1789185615.488540:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812372736 00000100:00100000:2.0:1789185615.488734:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:2.0:1789185615.488747:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791f906850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+56:10577:x1876096812372736:12345-192.168.202.54@tcp:103:lfs.0 00010000:00010000:2.0:1789185615.488763:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185615.488795:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c0dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d616 expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185615.488823:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:2.0:1789185615.488830:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185615.489197:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791f906850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+55:10577:x1876096812372736:12345-192.168.202.54@tcp:103:lfs.0 Request processed in 451us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185615.489205:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:1.0:1789185615.498344:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185615.500658:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812372864 00000100:00100000:2.0:1789185615.500675:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812372864 00000100:00100000:2.0:1789185615.500811:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00100000:2.0:1789185615.500824:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+55:10577:x1876096812372864:12345-192.168.202.54@tcp:58:lfs.0 00010000:00010000:2.0:1789185615.500948:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c18c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185615.500981:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c18c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185615.500994:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c18c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789185615.501184:0:11024:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789185615.501290:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+55:10577:x1876096812372864:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 468us (2959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185615.501298:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00100000:1.0:1789185615.508000:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185615.509089:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812372992 00000100:00100000:0.0:1789185615.509102:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812372992 00000100:00100000:0.0:1789185615.509225:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 111 00000100:00100000:0.0:1789185615.509237:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+55:10577:x1876096812372992:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789185615.509268:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185615.509290:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272c193 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d647 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.509348:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c18c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.509359:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272c193 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d647 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.509399:0:5823:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c18c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.509448:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272c193 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d647 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.509461:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:0.0:1789185615.509464:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789185615.509479:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272c193 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d647 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185615.509719:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355200, rc 0) 00000100:00100000:0.0:1789185615.509789:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+56:10577:x1876096812372992:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 554us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185615.509796:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 111 00010000:00010000:0.0:1789185616.015881:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789185616.463837:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789185616.463852:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789185616.463901:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789185616.463921:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789185616.466319:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78027d9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1876096821824256:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789185616.466488:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7929b2d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789185616.471194:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185616.471394:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812373120 00000100:00100000:3.0:1789185616.471451:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812373120 00000100:00100000:3.0:1789185616.471548:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 112 00000100:00100000:3.0:1789185616.471562:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+57:10578:x1876096812373120:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789185616.471617:0:5824:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789185616.471752:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+57:10578:x1876096812373120:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 194us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185616.471760:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 112 00000100:00080000:1.0:1789185616.471835:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185616.474767:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185616.475293:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812373248 00000100:00100000:2.0:1789185616.475306:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812373248 00000100:00100000:2.0:1789185616.475379:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00100000:2.0:1789185616.475390:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+57:10578:x1876096812373248:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789185616.475508:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c19a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.475530:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c19a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.475545:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c19a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185616.477924:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78027d9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1876096821824256:192.168.202.54@tcp:107:hsm_cdtr.0 00010000:00010000:2.0:1789185616.478863:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c1a1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.478894:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.478910:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.478969:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c1a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.478979:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.478987:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185616.479036:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789185616.479041:0:11024:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789185616.479054:0:11024:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479067:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c19a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479075:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c19a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479081:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c19a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479088:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185616.479092:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c19a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479100:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c19a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479111:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c792334af00) 00010000:00010000:2.0:1789185616.479121:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185616.479127:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c19a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479133:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c19a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479149:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479155:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c1a1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479161:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479166:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185616.479169:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479175:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c1a1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479183:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9c792334aa00) 00010000:00010000:2.0:1789185616.479186:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185616.479189:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c1a1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479194:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c1a1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479210:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479225:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c1a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479231:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479236:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185616.479239:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479246:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c1a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479253:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:2.0:1789185616.479256:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185616.479259:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c1a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.479265:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c1a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185616.481868:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+56:10578:x1876096812373248:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 Request processed in 6466us (7100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185616.481884:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00100000:1.0:1789185616.495721:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185616.496277:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812373504 00000100:00100000:3.0:1789185616.496286:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812373504 00000100:00100000:3.0:1789185616.496343:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:3.0:1789185616.496351:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+56:10578:x1876096812373504:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185616.496379:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185616.496397:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c1af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d64e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.500865:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.500885:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.500900:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185616.500914:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789185616.501031:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.501039:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.501047:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.501063:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185616.501067:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.501072:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.501082:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:3.0:1789185616.501098:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789185616.501104:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.501110:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.501170:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c1af lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d64e expref: 58 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.501181:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c792334af00) 00010000:00010000:3.0:1789185616.501184:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185616.501188:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c1af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d64e expref: 58 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.501198:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04e00, rc 0) 00000100:00100000:3.0:1789185616.501281:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+57:10578:x1876096812373504:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 4928us (5568us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1789185616.501290:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:1.0:1789185616.510215:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185616.510490:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812373632 00000100:00100000:3.0:1789185616.510511:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812373632 00000100:00100000:3.0:1789185616.510578:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00100000:3.0:1789185616.510590:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+57:10578:x1876096812373632:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789185616.510643:0:5823:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789185616.510763:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+57:10578:x1876096812373632:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 173us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185616.510771:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00100000:0.0:1789185616.513792:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185616.514372:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812373888 00000100:00100000:1.0:1789185616.514383:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812373888 00000100:00100000:1.0:1789185616.514479:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:1.0:1789185616.514489:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+57:10578:x1876096812373888:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185616.514510:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185616.514513:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789185616.514541:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c154 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d632 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.514570:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:1.0:1789185616.514576:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185616.514591:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c1c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d655 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789185616.515016:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789185616.515204:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c1cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.515231:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c1cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.515241:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c1cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.515522:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c1c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d655 expref: 59 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.515539:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c1cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d655 expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.515548:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c791aedca00) 00010000:00010000:1.0:1789185616.515550:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185616.515554:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4d000, rc 0) 00000100:00100000:1.0:1789185616.515760:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+58:10578:x1876096812373888:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1271us (1977us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789185616.515769:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:1.0:1789185616.549520:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185616.549614:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812374144 00000100:00100000:3.0:1789185616.549638:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812374144 00000100:00100000:3.0:1789185616.549702:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:3.0:1789185616.549714:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+58:10578:x1876096812374144:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789185616.549777:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185616.549805:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c1cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d655 expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.549824:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c791aedca00) 00010000:00010000:3.0:1789185616.549835:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185616.549857:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c1d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.549871:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c1d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.549880:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c1d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.549895:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x337a0ac4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.549901:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x337a0ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.549907:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x337a0ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.549974:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c1d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.549981:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c1d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.549995:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c1d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.550001:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185616.550006:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c1d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.550014:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c1d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.550022:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:3.0:1789185616.550025:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185616.550029:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c1d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.550035:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272c1d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.550045:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x337a0ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.550051:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x337a0ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.550070:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x337a0ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.550076:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185616.550079:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x337a0ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.550096:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x337a0ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.550105:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x337a0ac4 (ffff9c79055dd100) 00010000:00010000:3.0:1789185616.550108:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185616.550111:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x337a0ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.550117:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x337a0ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185616.550216:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+57:10578:x1876096812374144:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 504us (706us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789185616.550224:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:2.0:1789185616.552978:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185616.553214:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812374272 00000100:00100000:3.0:1789185616.553224:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812374272 00000100:00100000:3.0:1789185616.553289:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:3.0:1789185616.553311:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+57:10578:x1876096812374272:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185616.553333:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185616.553360:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c1e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d65c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.553393:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c1ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.553425:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c1ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.553439:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c1ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.553696:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c1e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d65c expref: 59 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.553715:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c1ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d65c expref: 58 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.553724:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:3.0:1789185616.553727:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789185616.553731:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04400, rc 0) 00000100:00100000:3.0:1789185616.553846:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+58:10578:x1876096812374272:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 547us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185616.553854:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:0.0:1789185616.560750:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185616.560830:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812374528 00000100:00100000:3.0:1789185616.560841:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812374528 00000100:00100000:3.0:1789185616.560905:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:3.0:1789185616.560916:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+58:10578:x1876096812374528:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789185616.560998:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.561015:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.561028:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789185616.561369:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1789185616.561379:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 313600973179ns, next at 314600971024ns, rc = 0 00000004:00010000:3.0:1789185616.561708:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000008f8955a reply state 0000000023007a67 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185616.561718:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789185616.561877:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+60:10578:x1876096812374528:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 960us (1134us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789185616.561885:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 119 00010000:00010000:3.0:1789185616.569398:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.569440:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.569448:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.569455:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185616.569460:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.569467:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.569485:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:3.0:1789185616.569488:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789185616.569493:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.569499:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c1f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185616.571759:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185616.571885:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812374656 00000100:00100000:1.0:1789185616.571897:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812374656 00000100:00100000:1.0:1789185616.571962:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:1.0:1789185616.571974:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+59:10578:x1876096812374656:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185616.572003:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185616.572025:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c1fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d663 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.572104:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c1fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d663 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.572120:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c1fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d663 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.572139:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:1.0:1789185616.572143:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789185616.572147:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4c000, rc 0) 00000100:00100000:1.0:1789185616.572352:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+60:10578:x1876096812374656:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 379us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185616.572360:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:1.0:1789185616.576524:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185616.576647:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812374784 00000100:00100000:2.0:1789185616.576657:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812374784 00000100:00100000:2.0:1789185616.576769:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:2.0:1789185616.576784:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2371:x1876096812374784:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789185616.577116:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2371:x1876096812374784:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 336us (714us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789185616.577124:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:2.0:1789185616.579993:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185616.580082:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812375040 00000100:00100000:0.0:1789185616.580106:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812375040 00000100:00100000:0.0:1789185616.580164:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:0.0:1789185616.580175:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+60:10578:x1876096812375040:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789185616.580460:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+61:10578:x1876096812375040:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 286us (476us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1789185616.580468:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00080000:1.0:1789185616.582275:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185616.583696:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185616.583997:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812375296 00000100:00100000:2.0:1789185616.584007:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812375296 00000100:00100000:2.0:1789185616.584074:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:2.0:1789185616.584086:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+61:10578:x1876096812375296:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789185616.584199:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+61:10578:x1876096812375296:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 115us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185616.584207:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:2.0:1789185616.588357:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185616.588490:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812375424 00000100:00100000:1.0:1789185616.588501:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812375424 00000100:00100000:1.0:1789185616.588567:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:1.0:1789185616.588578:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+61:10578:x1876096812375424:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185616.588633:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185616.588654:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c203 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d66a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.588724:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c20a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.588738:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c20a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.588764:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c20a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185616.588801:0:5822:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789185616.588822:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c20a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.588849:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c203 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d66a expref: 63 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.588867:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c20a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d66a expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.588875:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:1.0:1789185616.588877:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789185616.588882:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4c200, rc 0) 00000100:00100000:1.0:1789185616.588951:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+62:10578:x1876096812375424:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 375us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185616.588958:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:0.0:1789185616.593183:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185616.593286:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812375552 00000100:00100000:3.0:1789185616.593296:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812375552 00000100:00100000:3.0:1789185616.593356:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:3.0:1789185616.593367:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2371:x1876096812375552:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185616.593387:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185616.593448:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b0eaac4/0x532743011272c211 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d671 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789185616.593475:0:6884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4ce4f, blocks: 0x1 00010000:00010000:3.0:1789185616.593498:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789185616.593503:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185616.593513:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0eaac4/0x532743011272c211 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d671 expref: 10 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.593533:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b0eaac4/0x532743011272c211 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d671 expref: 10 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.593546:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04200, rc 0) 00000100:00100000:3.0:1789185616.593630:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+10:2371:x1876096812375552:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 264us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185616.593639:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:0.0:1789185616.597477:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185616.597579:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812375808 00000100:00100000:2.0:1789185616.597588:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812375808 00000100:00100000:2.0:1789185616.597661:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:2.0:1789185616.597670:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+62:10578:x1876096812375808:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789185616.597778:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+62:10578:x1876096812375808:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 109us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185616.597785:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:2.0:1789185616.601079:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185616.601165:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812375936 00000100:00100000:3.0:1789185616.601176:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812375936 00000100:00100000:3.0:1789185616.601243:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:3.0:1789185616.601254:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+10:10578:x1876096812375936:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185616.601282:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185616.601320:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2babf95/0x532743011272c218 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d678 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.601355:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b0eaac4/0x532743011272c211 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d671 expref: 11 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.601365:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185616.601369:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185616.601375:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2babf95/0x532743011272c218 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d678 expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.601448:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b0eaac4/0x532743011272c211 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d671 expref: 11 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.601465:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b0eaac4/0x532743011272c211 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d671 expref: 11 pid: 6884 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185616.601480:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876096821824384:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185616.601646:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b51900 going to sleep for 11 seconds 00000100:00100000:0.0:1789185616.606637:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185616.606762:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812376064 00000100:00100000:1.0:1789185616.606772:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812376064 00010000:00010000:1.0:1789185616.606815:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b0eaac4/0x532743011272c211 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d671 expref: 12 pid: 6884 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185616.606861:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:1.0:1789185616.606872:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:2372:x1876096812376064:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185616.606886:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185616.606927:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b0eaac4/0x532743011272c211 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d671 expref: 12 pid: 6884 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.606944:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b0eaac4/0x532743011272c211 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d671 expref: 12 pid: 6884 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.606971:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185616.606976:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185616.606985:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2babf95/0x532743011272c218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d678 expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.606997:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2babf95/0x532743011272c218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d678 expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.607061:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e2babf95/0x532743011272c218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d678 expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185616.607077:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7903420000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5809:1876096821824512:192.168.202.54@tcp:105: 00000100:00100000:1.0:1789185616.607178:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c794125e600 going to sleep for 11 seconds 00010000:00010000:3.0:1789185616.608090:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b0eaac4/0x532743011272c211 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d671 expref: 12 pid: 6884 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185616.608107:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876096821824384:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185616.608137:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2babf95/0x532743011272c218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d678 expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.608164:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04c00, rc 0) 00000100:00100000:3.0:1789185616.608213:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+11:10578:x1876096812375936:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 6961us (7145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185616.608221:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:1.0:1789185616.612486:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7903420000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5809:1876096821824512:192.168.202.54@tcp:105: 00010000:00010000:1.0:1789185616.612515:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185616.612567:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+10:2372:x1876096812376064:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5697us (5940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185616.612578:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:0.0:1789185616.616782:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185616.616879:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812376192 00000100:00100000:1.0:1789185616.616889:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812376192 00002000:00100000:1.0:1789185616.616950:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9c78027d8a80 x1876096812376192/t0(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:217/0 lens 504/0 e 0 to 0 dl 1789185627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789185616.616962:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c78027d8a80 with x1876096812376192 ext(0->12) 00002000:00010000:1.0:1789185616.616969:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c78027d8a80 00000100:00100000:1.0:1789185616.617001:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:1.0:1789185616.617009:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+10:2372:x1876096812376192:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789185616.617482:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:2372:x1876096812376192:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 Request processed in 472us (707us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789185616.617491:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00002000:00100000:1.0:1789185616.617498:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9c78027d8a80 x1876096812376192/t4294967308(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:217/0 lens 504/448 e 0 to 0 dl 1789185627 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789185616.617507:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c78027d8a80 with x1876096812376192 ext(0->12) 00002000:00010000:1.0:1789185616.617510:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c78027d8a80 00000100:00100000:0.0:1789185616.619976:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185616.620165:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812376320 00000100:00100000:1.0:1789185616.620174:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812376320 00000100:00100000:1.0:1789185616.620292:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:1.0:1789185616.620303:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+62:10578:x1876096812376320:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789185616.649909:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1789185616.649936:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1789185616.649961:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789185616.649978:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c793693d240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789185616.649983:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c79202cc800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c793693da80 00000020:00080000:2.0:1789185616.649998:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c79202cc200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c7907cc0800 00000020:00080000:2.0:1789185616.650023:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c78031ee000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789185616.650026:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7936b41c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c78031eec00 00000020:00080000:2.0:1789185616.650029:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7936b41100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c792ff59c00 00000004:00080000:2.0:1789185616.650042:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1789185616.650195:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789185616.650374:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789185616.650395:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78026a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821824640:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789185616.650503:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185616.650557:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821824640 00000100:00100000:2.0:1789185616.650564:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821824640 00000100:00100000:2.0:1789185616.650626:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789185616.650636:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7940efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3278:x1876096821824640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789185616.650661:0:6884:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1789185616.650693:0:6884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa4ce4e, atime: 0x6aa4ce4e, ctime: 0x6aa4ce4e, blocks: 0x1 00010000:00010000:2.0:1789185616.650701:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7895d24/0x532743011272c21f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.650718:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1789185616.650723:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185616.650730:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7895d24/0x532743011272c21f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.650747:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7895d24/0x532743011272c21f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.650771:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7895d24/0x532743011272c21f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.650779:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7895d24/0x532743011272c21f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.650797:0:6884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789185616.651228:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7940efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3278:x1876096821824640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 592us (724us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789185616.651236:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1789185616.651382:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789185616.651393:0:11163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185616.651398:0:11163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7895d24/0x532743011272c21f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.651436:0:11163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6000 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185616.651441:0:11163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7895d24/0x532743011272c21f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.651451:0:11163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7895d24/0x532743011272c21f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.651470:0:11163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7895d24/0x532743011272c21f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.651489:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7895d24/0x532743011272c21f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.651511:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185616.651513:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185616.651514:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789185616.651548:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c78026a1880/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789185616.651555:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78026a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821824640:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789185616.651665:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:10578:x1876096812376320:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 Request processed in 31362us (31696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185616.651674:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:0.0:1789185616.652130:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78027da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821824896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789185616.652167:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185616.652208:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821824896 00000100:00100000:0.0:1789185616.652214:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821824896 00000100:00100000:0.0:1789185616.652272:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789185616.652281:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1876096821824896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789185616.652400:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789185616.652435:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789185615 00002000:00010000:0.0:1789185616.652438:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789185616.652441:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789185615 -> 1789185615 00002000:00010000:0.0:1789185616.652443:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789185616.652478:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1876096821824896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 198us (310us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789185616.652484:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789185616.652510:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78027db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821824768:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789185616.652534:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789185616.652558:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789185616.652579:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c78027da680/2, rc 0, transno 4294967309 00000100:00100000:0.0:1789185616.652584:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78027da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821824896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789185616.652614:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821824768 00000100:00100000:0.0:1789185616.652618:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821824768 00000100:00100000:0.0:1789185616.652642:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789185616.652650:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3279:x1876096821824768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789185616.652664:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1789185616.652680:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272c226 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.652698:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c46e77cf/0x532743011272bfe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5d7 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.652707:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789185616.652711:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789185616.652716:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272c226 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.652744:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c46e77cf/0x532743011272bfe1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5d7 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.652762:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c46e77cf/0x532743011272bfe1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5d7 expref: 11 pid: 6679 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185616.652789:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876096821825024:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789185616.652845:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7929b2d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789185616.658227:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185616.658466:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876096821825024:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185616.658493:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272c226 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185616.658675:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812376448 00000100:00100000:2.0:1789185616.658683:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812376448 00000100:00100000:2.0:1789185616.658740:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:2.0:1789185616.658750:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:2372:x1876096812376448:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789185616.663242:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185616.663475:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812376576 00000100:00100000:2.0:1789185616.663485:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812376576 00010000:00010000:2.0:1789185616.663526:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c46e77cf/0x532743011272bfe1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5d7 expref: 13 pid: 6679 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185616.663558:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:2.0:1789185616.663566:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903420000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:2372:x1876096812376576:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185616.663581:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185616.663586:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c46e77cf/0x532743011272bfe1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5d7 expref: 13 pid: 6679 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.663622:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c46e77cf/0x532743011272bfe1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5d7 expref: 13 pid: 6679 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.663645:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c46e77cf/0x532743011272bfe1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5d7 expref: 13 pid: 6679 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.663662:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185616.663667:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185616.663673:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272c226 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.663683:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272c226 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.663708:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185616.663758:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903420000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:2372:x1876096812376576:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 192us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185616.663766:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 55 00010000:00010000:1.0:1789185616.664126:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272c226 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.664138:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272c226 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.664148:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272c226 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.664162:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272c226 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.664184:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185616.665564:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185616.665576:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272c226 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.665589:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355800 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185616.665594:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272c226 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.665614:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272c226 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.665634:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272c226 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.665641:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272c226 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.665677:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185616.665679:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185616.665681:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185616.666365:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3279:x1876096821824768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13710us (13824us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789185616.666375:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1789185616.667936:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c78027db480/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789185616.667950:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78027db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821824768:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789185616.691484:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+11:2372:x1876096812376448:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 Request processed in 32724us (33254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185616.691497:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00000001:00080000:1.0:1789185616.691650:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1789185616.691661:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1789185616.691668:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1789185616.694835:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185616.695071:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812376832 00000100:00100000:0.0:1789185616.695081:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812376832 00000100:00100000:0.0:1789185616.695141:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:0.0:1789185616.695151:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:10578:x1876096812376832:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789185616.695202:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185616.695229:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c20a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d66a expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.695461:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:0.0:1789185616.695468:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185616.695501:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272c22d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.695516:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272c22d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.695525:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272c22d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789185616.695795:0:11024:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ffa05279 reply state 00000000bcf8fde3 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272c22d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185616.695805:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789185616.695915:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:10578:x1876096812376832:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 764us (1089us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1789185616.695937:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 125 00010000:00010000:3.0:1789185616.699104:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272c22d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.699120:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272c22d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.699129:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272c22d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.699135:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185616.699140:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272c22d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.699147:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272c22d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.699163:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:3.0:1789185616.699166:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185616.699170:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272c22d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.699196:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354200/0x532743011272c22d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185616.699548:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185616.699703:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812376960 00000100:00100000:3.0:1789185616.699714:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812376960 00000100:00100000:3.0:1789185616.699762:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:3.0:1789185616.699771:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812376960:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789185616.699982:0:6884:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789185616.699986:0:6884:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789185615 -> 1789185614 00002000:00010000:3.0:1789185616.699988:0:6884:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789185614 00002000:00010000:3.0:1789185616.699990:0:6884:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789185615 -> 1789185614 00002000:00010000:3.0:1789185616.699992:0:6884:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789185616.700067:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2372:x1876096812376960:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 296us (524us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789185616.700075:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:3.0:1789185616.702818:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185616.702901:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812377216 00000100:00100000:2.0:1789185616.702911:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812377216 00000100:00100000:2.0:1789185616.702979:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:2.0:1789185616.702989:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:10578:x1876096812377216:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789185616.703059:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c234 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.703093:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c1ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d65c expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.703102:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c234 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.703138:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c1ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d65c expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.703157:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c1ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d65c expref: 15 pid: 5824 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185616.703173:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78026a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876096821825152:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185616.703281:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185616.706152:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78026a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876096821825152:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185616.706185:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c234 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185616.708285:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185616.711532:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812377344 00000100:00100000:2.0:1789185616.711549:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812377344 00010000:00010000:2.0:1789185616.711681:0:6692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c1ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d65c expref: 16 pid: 5824 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185616.711832:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:2.0:1789185616.711843:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:2371:x1876096812377344:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185616.711857:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185616.711864:0:6692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c1ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d65c expref: 16 pid: 5824 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.711881:0:6692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c1ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d65c expref: 16 pid: 5824 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.711921:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c1ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d65c expref: 16 pid: 5824 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.711938:0:6692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:2.0:1789185616.711944:0:6692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c234 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.711953:0:6692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c234 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.711961:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c234 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.711997:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185616.712068:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:2371:x1876096812377344:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 227us (3791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185616.712076:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 56 00010000:00010000:0.0:1789185616.712147:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c234 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.712156:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c234 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.712184:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c234 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.712191:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c234 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.712198:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c234 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.712204:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185616.712208:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c234 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.712215:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c234 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.712224:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:0.0:1789185616.712227:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789185616.712231:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c234 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.712248:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c234 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185616.712309:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:10578:x1876096812377216:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 Request processed in 9321us (9502us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789185616.712317:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:0.0:1789185616.715328:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185616.715452:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812377472 00000100:00100000:1.0:1789185616.715462:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812377472 00000100:00100000:1.0:1789185616.715513:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:1.0:1789185616.715523:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2372:x1876096812377472:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789185616.715571:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ba1b3f24/0x532743011272c23b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.715590:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2babf95/0x532743011272c218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d678 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.715599:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185616.715614:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185616.715618:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba1b3f24/0x532743011272c23b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.715666:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2babf95/0x532743011272c218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d678 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.715683:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2babf95/0x532743011272c218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d678 expref: 7 pid: 6676 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185616.715698:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7903422300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876096821825280:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789185616.715774:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c794125ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185616.722127:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185616.722235:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7903422300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876096821825280:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185616.722280:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba1b3f24/0x532743011272c23b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185616.722670:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812377600 00000100:00100000:2.0:1789185616.722678:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812377600 00010000:00010000:2.0:1789185616.722716:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2babf95/0x532743011272c218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d678 expref: 8 pid: 6676 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185616.722755:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:2.0:1789185616.722765:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903423100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2371:x1876096812377600:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185616.722782:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185616.722809:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2babf95/0x532743011272c218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d678 expref: 8 pid: 6676 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.722837:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2babf95/0x532743011272c218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d678 expref: 8 pid: 6676 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.722858:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2babf95/0x532743011272c218 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d678 expref: 8 pid: 6676 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.722872:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185616.722876:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185616.722881:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba1b3f24/0x532743011272c23b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.722889:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba1b3f24/0x532743011272c23b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.722921:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185616.722969:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903423100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2371:x1876096812377600:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 204us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185616.722977:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 57 00010000:00010000:1.0:1789185616.723706:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba1b3f24/0x532743011272c23b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.723719:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba1b3f24/0x532743011272c23b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.723749:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ba1b3f24/0x532743011272c23b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.723758:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba1b3f24/0x532743011272c23b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.723767:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba1b3f24/0x532743011272c23b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.723774:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d400 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185616.723789:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba1b3f24/0x532743011272c23b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.723798:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba1b3f24/0x532743011272c23b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.723813:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba1b3f24/0x532743011272c23b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185616.723821:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba1b3f24/0x532743011272c23b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185616.723900:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812377472:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 Request processed in 8376us (8580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185616.723910:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:1.0:1789185616.730873:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185616.730964:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812377856 00000100:00100000:3.0:1789185616.730976:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812377856 00000100:00100000:3.0:1789185616.731043:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00100000:3.0:1789185616.731055:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:10578:x1876096812377856:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789185616.731144:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c242 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.731162:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.731173:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.731892:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c249 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.731910:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c1fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d663 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.731917:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c249 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.731971:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c1fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d663 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.731989:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c1fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d663 expref: 15 pid: 5822 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185616.732004:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78026a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876096821825408:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185616.732095:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee600 going to sleep for 11 seconds 00000100:00100000:0.0:1789185616.735952:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185616.736022:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812377984 00000100:00100000:3.0:1789185616.736032:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812377984 00010000:00010000:3.0:1789185616.736074:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c1fc lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d663 expref: 16 pid: 5822 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185616.736116:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:3.0:1789185616.736125:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:2371:x1876096812377984:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185616.736139:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185616.736146:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c1fc lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d663 expref: 16 pid: 5822 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.736162:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c1fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d663 expref: 16 pid: 5822 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.736204:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:3.0:1789185616.736209:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c249 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.736219:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c249 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.736227:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c249 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185616.736263:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185616.736318:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:2371:x1876096812377984:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 193us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185616.736325:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 58 00010000:00010000:2.0:1789185616.737706:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c1fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d663 expref: 15 pid: 5822 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185616.737728:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78026a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876096821825408:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789185616.737752:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c249 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.737763:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c249 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.737770:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c249 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185616.737952:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1789185616.738080:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1789185616.738119:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1789185616.738187:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78026a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1876096821825536:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789185616.738346:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185616.738487:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185616.738800:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821825536 00000100:00100000:0.0:1789185616.738807:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821825536 00000100:00100000:0.0:1789185616.738909:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789185616.738919:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1876096821825536:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789185616.739005:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1876096821825536:12345-0@lo:1000:mdt00_001.0 Request processed in 87us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185616.739012:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789185616.739072:0:5823:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1789185616.739078:0:5823:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1789185616.739093:0:5823:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c78027da680, transno 4294967309 00000100:00100000:2.0:1789185616.739117:0:5823:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c78027db480 x1876096821824768/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789185632 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185616.739127:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78026a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1876096821825536:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789185616.739637:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1789185616.739701:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78026a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1876096821825664:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789185616.739735:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185616.740267:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee600 going to sleep for 11 seconds 00000100:00100000:3.0:1789185616.740368:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821825664 00000100:00100000:3.0:1789185616.740374:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821825664 00000100:00100000:3.0:1789185616.740484:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789185616.740495:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5823:x1876096821825664:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789185616.740764:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5823:x1876096821825664:12345-0@lo:1000:mdt00_001.0 Request processed in 272us (1027us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789185616.740772:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789185616.740949:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78026a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1876096821825664:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789185616.740982:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c249 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.740991:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c249 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.740999:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c249 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.741006:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185616.741011:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c249 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.741019:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c249 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.741033:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:2.0:1789185616.741036:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185616.741050:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c249 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.741056:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c249 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.741087:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c18c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.741094:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c18c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.741100:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c18c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.741106:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185616.741109:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c18c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.741115:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c18c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.741124:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:2.0:1789185616.741126:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185616.741133:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272c193 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d647 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.741144:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272c193 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d647 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.741154:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272c193 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d647 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.741192:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272c193 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d647 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185616.741204:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78026a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876096821825792:192.168.202.54@tcp:105: 00000100:00100000:2.0:1789185616.741504:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee600 going to sleep for 11 seconds 00000100:00100000:0.0:1789185616.744803:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185616.744871:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812378112 00000100:00100000:1.0:1789185616.744880:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812378112 00000100:00100000:1.0:1789185616.744930:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:1.0:1789185616.744940:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:10577:x1876096812378112:12345-192.168.202.54@tcp:49:lfs.0 00000100:00100000:1.0:1789185616.745104:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:10577:x1876096812378112:12345-192.168.202.54@tcp:49:lfs.0 Request processed in 164us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185616.745112:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:2.0:1789185616.745201:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78026a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876096821825792:192.168.202.54@tcp:105: 00010000:00010000:2.0:1789185616.745230:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c18c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745355:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c18c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745389:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c250 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745429:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c250 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745440:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c250 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745450:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c250 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745456:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c250 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745463:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c250 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745485:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185616.745490:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c250 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745498:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c250 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745510:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:2.0:1789185616.745513:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185616.745518:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c250 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745524:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c250 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745534:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745539:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c242 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745546:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c242 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745551:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185616.745554:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c242 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745560:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c242 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745578:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:2.0:1789185616.745580:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789185616.745583:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c242 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.745590:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c242 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185616.745844:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+18:10578:x1876096812377856:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 14791us (14981us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789185616.745852:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 127 00000020:00080000:2.0:1789185616.745856:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789185616.749867:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185616.749874:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185616.750507:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789185616.750516:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789185616.750703:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185616.750743:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185616.750880:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812378624 00000100:00100000:0.0:1789185616.750890:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812378624 00000100:00100000:0.0:1789185616.750940:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:0.0:1789185616.750948:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791916f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+18:10578:x1876096812378624:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789185616.751591:0:5825:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789185616.751710:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1789185616.751752:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c257 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.751770:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c257 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.751781:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c257 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.751800:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c257 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.751807:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c257 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.751814:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c257 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.751832:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789185616.751921:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791916f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:10578:x1876096812378624:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 972us (1175us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789185616.751929:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 32 00000020:00080000:0.0:1789185616.751934:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789185616.751979:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185616.751984:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c257 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.751992:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355000 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185616.751996:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c257 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.752005:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c257 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.752017:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c79117a4500) 00010000:00010000:0.0:1789185616.752019:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789185616.752025:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c257 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.752042:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c257 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.752057:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185616.752059:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185616.752060:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185616.752340:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812378368 00000100:00100000:3.0:1789185616.752348:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812378368 00000100:00100000:3.0:1789185616.752391:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 128 00000100:00100000:3.0:1789185616.753017:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:10577:x1876096812378368:12345-192.168.202.54@tcp:58:lfs.0 00000040:00080000:3.0:1789185616.753257:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789185616.754945:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:10577:x1876096812378368:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 2533us (4239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185616.754957:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 128 00000100:00100000:0.0:1789185616.772946:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185616.773115:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812378752 00000100:00100000:2.0:1789185616.773125:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812378752 00000100:00100000:2.0:1789185616.773202:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 129 00000100:00100000:2.0:1789185616.773210:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:10580:x1876096812378752:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185616.773231:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185616.773251:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c25e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d67f expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.773314:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c265 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.773328:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c265 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.773340:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c265 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.773367:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c26c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.773375:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c26c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.773383:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c26c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.773711:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c273 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.773719:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d640 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.773725:0:11024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c273 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.773751:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d640 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.773763:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d640 expref: 21 pid: 5822 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185616.773773:0:11024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78026a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1876096821825920:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185616.773846:0:11024:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185616.775848:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185616.776126:0:11024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78026a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1876096821825920:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789185616.776152:0:11024:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c273 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185616.776222:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812379008 00000100:00100000:0.0:1789185616.776228:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812379008 00000100:00100000:0.0:1789185616.776283:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:0.0:1789185616.776293:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+22:5612:x1876096812379008:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789185616.776774:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+23:5612:x1876096812379008:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 476us (929us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789185616.776782:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:1.0:1789185616.778629:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185616.778748:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812379136 00000100:00100000:2.0:1789185616.778758:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812379136 00010000:00010000:2.0:1789185616.778797:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d640 expref: 23 pid: 5822 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185616.778836:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:2.0:1789185616.778846:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+23:2372:x1876096812379136:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185616.778860:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185616.778867:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d640 expref: 23 pid: 5822 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.778882:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d640 expref: 23 pid: 5822 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.778903:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c17e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d640 expref: 23 pid: 5822 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.778918:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:2.0:1789185616.778922:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c273 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.778929:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.778934:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c273 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185616.778958:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185616.778979:0:11024:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.778987:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185616.779029:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789185616.779034:0:11024:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185616.779053:0:11024:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779066:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185616.779067:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+22:2372:x1876096812379136:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 222us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185616.779075:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00010000:00010000:0.0:1789185616.779077:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c265 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779090:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c265 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779097:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c265 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779102:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185616.779107:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c265 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779115:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c265 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779123:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:0.0:1789185616.779126:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185616.779130:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c265 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779135:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c265 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779147:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c26c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779153:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c26c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779159:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c26c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779164:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185616.779173:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c26c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779179:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c26c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779185:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c792334aa00) 00010000:00010000:0.0:1789185616.779188:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185616.779191:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c26c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779196:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c26c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779233:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c25e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d67f expref: 22 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779252:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c273 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d67f expref: 21 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185616.779260:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:0.0:1789185616.779262:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185616.779708:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6000, rc 0) 00000100:00100000:0.0:1789185616.779752:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:10580:x1876096812378752:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 6541us (6815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185616.779759:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 129 00010000:00010000:2.0:1789185617.040130:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185617.545861:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185617.545910:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185617.545938:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185617.545957:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185617.545995:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185617.546022:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812379520 00000100:00100000:1.0:1789185617.546031:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812379520 00000100:00100000:1.0:1789185617.546084:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812379648 00000100:00100000:1.0:1789185617.546088:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812379648 00000100:00100000:1.0:1789185617.546111:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:1.0:1789185617.546120:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2370:x1876096812379520:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185617.546192:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2370:x1876096812379520:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 72us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185617.546199:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:1.0:1789185617.546219:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:1.0:1789185617.546226:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812379648:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185617.546252:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812379648:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 26us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185617.546258:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:1.0:1789185617.546278:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812379776 00000100:00100000:1.0:1789185617.546281:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812379776 00000100:00100000:1.0:1789185617.546306:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812379392 00000100:00100000:1.0:1789185617.546310:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812379392 00000100:00100000:1.0:1789185617.546329:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 142 00000100:00100000:1.0:1789185617.546335:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812379776:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185617.546364:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812379776:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 29us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185617.546380:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 142 00000100:00100000:1.0:1789185617.546393:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 143 00000100:00100000:1.0:1789185617.546400:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:2370:x1876096812379392:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185617.546450:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:2370:x1876096812379392:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 51us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185617.546457:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 143 00000100:00100000:0.0:1789185617.546677:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812379264 00000100:00100000:0.0:1789185617.546682:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812379264 00000100:00100000:0.0:1789185617.546718:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 290 00000100:00100000:0.0:1789185617.546725:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812379264:12345-192.168.202.54@tcp:400:kworker.0 00000100:00080000:3.0:1789185617.550729:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185617.550742:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185617.556243:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812379264:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 9506us (10379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185617.556258:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 290 00000040:00080000:3.0:1789185617.574868:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185617.574876:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185617.574922:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789185617.574927:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789185617.807958:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185617.807968:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185617.808027:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789185617.808034:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789185617.808163:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1876096821826048:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789185617.808331:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b51780 going to sleep for 11 seconds 00000100:00100000:3.0:1789185617.811886:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1876096821826048:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789185617.814783:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185617.815243:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812379904 00000100:00100000:1.0:1789185617.815253:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812379904 00000100:00100000:1.0:1789185617.815314:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 130 00000100:00100000:1.0:1789185617.815324:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:10592:x1876096812379904:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789185617.815358:0:5822:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789185617.815682:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:10592:x1876096812379904:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 357us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185617.815690:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 130 00000100:00100000:1.0:1789185617.829156:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185617.829281:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812380160 00000100:00100000:0.0:1789185617.829291:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812380160 00000100:00100000:0.0:1789185617.829366:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:0.0:1789185617.829377:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:10592:x1876096812380160:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185617.829443:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185617.829465:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c27a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d686 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185617.829564:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c281 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185617.829579:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185617.829601:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185617.829613:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789185617.829742:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c27a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d686 expref: 24 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185617.829759:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d686 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185617.829768:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:0.0:1789185617.829785:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185617.829789:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354600, rc 0) 00000100:00100000:0.0:1789185617.829849:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+23:10592:x1876096812380160:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 474us (702us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789185617.829856:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:2.0:1789185617.844524:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185617.845283:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812380288 00000100:00100000:3.0:1789185617.845295:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812380288 00000100:00100000:3.0:1789185617.845383:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:3.0:1789185617.845849:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791f907050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+23:2371:x1876096812380288:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185617.845866:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185617.845893:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c281 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d686 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185617.845912:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:3.0:1789185617.845929:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185617.845993:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791f907050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+22:2371:x1876096812380288:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 149us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185617.846000:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:2.0:1789185617.859011:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185617.859353:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812380544 00000100:00100000:3.0:1789185617.859366:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812380544 00000100:00100000:3.0:1789185617.859466:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 132 00000100:00100000:3.0:1789185617.859477:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+22:10592:x1876096812380544:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789185617.859558:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c28f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185617.859577:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c28f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185617.859589:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c28f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185617.859798:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c28f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185617.859806:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c28f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185617.859812:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c28f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185617.859818:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185617.859822:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c28f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185617.859829:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c28f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185617.859855:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:3.0:1789185617.859858:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789185617.859864:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c28f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185617.859869:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c28f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185617.860051:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+23:10592:x1876096812380544:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 575us (1050us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789185617.860059:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 132 00000040:00080000:0.0:1789185617.860341:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789185617.860348:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789185617.860865:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789185617.860873:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789185617.864990:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185617.865100:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812380800 00000100:00100000:2.0:1789185617.865110:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812380800 00000100:00100000:2.0:1789185617.865172:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:2.0:1789185617.865182:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+23:10592:x1876096812380800:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789185617.865500:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+24:10592:x1876096812380800:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 316us (517us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789185617.865507:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 34 00010000:00010000:2.0:1789185618.063745:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185618.831939:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821826176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185618.832034:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185618.832682:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821826176 00000100:00100000:2.0:1789185618.832691:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821826176 00000100:00100000:3.0:1789185618.832859:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789185618.832876:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1876096821826176:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185618.832914:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821826304:0@lo:400:kworker.0 00002000:00000024:3.0:1789185618.832928:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789185618.832963:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789185618.833218:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185618.833299:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821826560:0@lo:400:kworker.0 00000100:00100000:0.0:1789185618.833387:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821826816:0@lo:400:kworker.0 00000100:00100000:0.0:1789185618.833441:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185618.833468:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821826816 00000100:00100000:2.0:1789185618.833473:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821826816 00000100:00100000:2.0:1789185618.833514:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789185618.833522:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821826816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185618.833552:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185618.833558:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821826432:0@lo:400:kworker.0 00000100:00100000:2.0:1789185618.833560:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821826816:12345-0@lo:400:kworker.0 Request processed in 39us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185618.833567:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789185618.833579:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185618.833776:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821826816:0@lo:400:kworker.0 00000100:00100000:0.0:1789185618.833815:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821826304 00000100:00100000:0.0:1789185618.833819:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821826304 00000100:00100000:0.0:1789185618.833861:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789185618.833868:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821826304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185618.833905:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821826304:12345-0@lo:400:kworker.0 Request processed in 37us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185618.833910:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789185618.833957:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821826304:0@lo:400:kworker.0 00000100:00100000:2.0:1789185618.834031:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821826432 00000100:00100000:2.0:1789185618.834035:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821826432 00000100:00100000:2.0:1789185618.834061:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789185618.834068:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821826432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185618.834109:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821826432:12345-0@lo:400:kworker.0 Request processed in 41us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185618.834115:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789185618.834638:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821826432:0@lo:400:kworker.0 00000100:00100000:2.0:1789185618.835103:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821826688:0@lo:400:kworker.0 00000100:00100000:2.0:1789185618.835147:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185618.835187:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821826176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185618.835212:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821826688 00000100:00100000:2.0:1789185618.835216:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821826688 00000100:00100000:2.0:1789185618.835251:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789185618.835258:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3281:x1876096821826688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185618.835294:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3281:x1876096821826688:12345-0@lo:400:kworker.0 Request processed in 36us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185618.835300:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789185618.835325:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821826688:0@lo:400:kworker.0 00000100:00080000:2.0:1789185618.835347:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789185618.835351:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185618.836027:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1876096821826176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3152us (3989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185618.836040:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789185618.846253:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185618.846329:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821826560 00000100:00100000:2.0:1789185618.846342:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821826560 00000100:00100000:2.0:1789185618.846455:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789185618.846469:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821826560:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789185618.846472:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185618.846554:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821826560:12345-0@lo:400:kworker.0 Request processed in 88us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185618.846561:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789185618.846754:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821826560:0@lo:400:kworker.0 00010000:00010000:2.0:1789185619.087752:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789185619.406968:0:12156:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789185619.406983:0:12156:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185619.407208:0:12156:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789185619.407215:0:12156:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1789185619.437276:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1789185619.437299:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1789185619.437314:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1789185619.617926:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185619.618018:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812381056 00000100:00100000:1.0:1789185619.618029:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812381056 00000100:00100000:1.0:1789185619.618105:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 133 00000100:00100000:1.0:1789185619.618117:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+24:10613:x1876096812381056:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789185619.618151:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185619.618173:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c296 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d68d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185619.618276:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272c29d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185619.618291:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272c29d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185619.618305:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272c29d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185619.618316:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789185619.618466:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c296 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d68d expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185619.618485:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272c29d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d68d expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185619.618494:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:1.0:1789185619.618497:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789185619.618501:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4de00, rc 0) 00000100:00100000:1.0:1789185619.618558:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:10613:x1876096812381056:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 443us (642us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789185619.618566:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 133 00000100:00080000:3.0:1789185619.618750:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185619.622070:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185619.622116:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812381184 00000100:00100000:3.0:1789185619.622126:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812381184 00000100:00100000:3.0:1789185619.622184:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 134 00000100:00100000:3.0:1789185619.622196:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:10613:x1876096812381184:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:3.0:1789185619.622266:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185619.622294:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185619.622308:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185619.622335:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185619.622342:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185619.622349:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185619.622356:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185619.622360:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185619.622367:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185619.622379:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:3.0:1789185619.622382:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185619.622388:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185619.622394:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185619.622484:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:10613:x1876096812381184:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 290us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185619.622498:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 134 00000100:00100000:1.0:1789185619.809045:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185619.809450:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812381312 00000100:00100000:3.0:1789185619.809461:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812381312 00000100:00100000:3.0:1789185619.809543:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:3.0:1789185619.809555:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812381312:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:3.0:1789185619.809583:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185619.809605:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000525deea4/0x532743011272c2b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d694 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789185619.809632:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa4ce4e, atime: 0x6aa4ce4e, ctime: 0x6aa4ce4e, blocks: 0xb 00010000:00010000:3.0:1789185619.809652:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=316s v=(0 0) 00010000:00010000:3.0:1789185619.809656:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185619.809674:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000525deea4/0x532743011272c2b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d694 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185619.809695:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000525deea4/0x532743011272c2b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d694 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185619.809707:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04e00, rc 0) 00000100:00100000:3.0:1789185619.809768:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2370:x1876096812381312:12345-192.168.202.54@tcp:101:cat.0 Request processed in 216us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185619.809776:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00080000:1.0:1789185619.810033:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185619.814076:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185619.814188:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812381440 00000100:00100000:2.0:1789185619.814199:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812381440 00002000:00100000:2.0:1789185619.814263:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9c7936cf0e00 x1876096812381440/t0(0) o3->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:220/0 lens 488/0 e 0 to 0 dl 1789185630 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185619.814284:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7936cf0e00 with x1876096812381440 ext(0->4095) 00002000:00010000:2.0:1789185619.814291:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7936cf0e00 00000100:00100000:2.0:1789185619.814327:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:2.0:1789185619.814337:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2370:x1876096812381440:12345-192.168.202.54@tcp:3:cat.0 00000100:00100000:2.0:1789185619.814596:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2370:x1876096812381440:12345-192.168.202.54@tcp:3:cat.0 Request processed in 260us (530us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789185619.814604:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00002000:00100000:2.0:1789185619.814611:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9c7936cf0e00 x1876096812381440/t0(0) o3->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:220/0 lens 488/4536 e 0 to 0 dl 1789185630 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185619.814620:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7936cf0e00 with x1876096812381440 ext(0->4095) 00002000:00010000:2.0:1789185619.814624:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7936cf0e00 00000100:00100000:0.0:1789185619.855958:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185619.855985:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821826944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185619.856058:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185619.856179:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821826944 00000100:00100000:3.0:1789185619.856188:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821826944 00000100:00100000:3.0:1789185619.856282:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789185619.856292:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821826944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185619.856328:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185619.856388:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821826944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185619.856395:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789185619.856916:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789185619.856923:0:3278:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1789185619.856942:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c78026a1880, transno 4294967304 00000100:00100000:0.0:1789185619.856969:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821826944:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789185620.113602:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185621.138804:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789185621.987969:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:2.0:1789185621.987992:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1789185621.988013:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c78031ee180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1789185621.988018:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7941031900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c78031eef00 00000020:00080000:2.0:1789185621.988022:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7941031b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c792f81d800 00000020:00080000:2.0:1789185621.988045:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1789185621.988064:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1789185621.988519:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1789185622.006898:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1789185622.006913:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1789185622.006917:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:2.0:1789185622.161537:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185622.666616:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185622.666650:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185622.666684:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185622.666704:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185622.666726:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185622.667302:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812381568 00000100:00100000:1.0:1789185622.667325:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812381568 00000100:00100000:1.0:1789185622.667388:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 292 00000100:00100000:1.0:1789185622.667398:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2372:x1876096812381568:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185622.667508:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2372:x1876096812381568:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 111us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185622.667516:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 292 00000100:00100000:1.0:1789185622.667564:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812382080 00000100:00100000:1.0:1789185622.667568:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812382080 00000100:00100000:1.0:1789185622.667604:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812381696 00000100:00100000:1.0:1789185622.667608:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812381696 00000100:00100000:1.0:1789185622.667629:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 147 00000100:00100000:1.0:1789185622.667648:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2372:x1876096812382080:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185622.667679:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2372:x1876096812382080:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 44us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185622.667685:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 147 00000100:00100000:1.0:1789185622.667698:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 148 00000100:00100000:1.0:1789185622.667704:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:2372:x1876096812381696:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185622.667727:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:2372:x1876096812381696:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 22us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185622.667732:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 148 00000100:00080000:1.0:1789185622.667753:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185622.668800:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812381824 00000100:00100000:0.0:1789185622.668809:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812381824 00000100:00100000:0.0:1789185622.669210:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812381952 00000100:00100000:0.0:1789185622.669215:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812381952 00000100:00100000:0.0:1789185622.669252:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:0.0:1789185622.669262:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2372:x1876096812381824:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185622.669333:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2372:x1876096812381824:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 73us (2680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185622.669353:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:0.0:1789185622.669370:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:0.0:1789185622.669377:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812381952:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185622.669435:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812381952:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 57us (2708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185622.669441:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00080000:1.0:1789185622.670426:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185622.670432:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789185623.184351:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185623.951641:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185623.951667:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78026a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821827072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185623.951752:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185623.951827:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821827072 00000100:00100000:2.0:1789185623.951835:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821827072 00000100:00100000:2.0:1789185623.951891:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789185623.951903:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821827072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789185623.951943:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185623.951990:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821827072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185623.951997:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789185623.952041:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1789185623.952047:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c78027db480, transno 4294967310 00000004:00080000:2.0:1789185623.952056:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1789185623.952083:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78026a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821827072:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789185623.952174:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185623.955990:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78026a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821827328:0@lo:400:kworker.0 00000100:00100000:2.0:1789185623.956058:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185623.956091:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789185623.956096:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821827456:0@lo:400:kworker.0 00000100:00100000:2.0:1789185623.956112:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185623.956134:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78026a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821827200:0@lo:400:kworker.0 00000100:00100000:2.0:1789185623.956160:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185623.956183:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821827712:0@lo:400:kworker.0 00000100:00100000:2.0:1789185623.956200:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185623.956215:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185623.956226:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821827584:0@lo:400:kworker.0 00000100:00100000:2.0:1789185623.956248:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185623.956278:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821827200 00000100:00100000:2.0:1789185623.956285:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821827200 00000100:00100000:2.0:1789185623.956326:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789185623.956334:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821827200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185623.956378:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821827200:12345-0@lo:400:kworker.0 Request processed in 45us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185623.956385:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789185623.956430:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821827584 00000100:00100000:2.0:1789185623.956433:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821827584 00000100:00100000:2.0:1789185623.956463:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789185623.956469:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821827584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185623.956496:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821827584:12345-0@lo:400:kworker.0 Request processed in 28us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185623.956502:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789185623.956531:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821827584:0@lo:400:kworker.0 00000100:00100000:2.0:1789185623.956552:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78026a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821827200:0@lo:400:kworker.0 00000100:00100000:1.0:1789185623.957093:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821827328 00000100:00100000:1.0:1789185623.957100:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821827328 00000100:00100000:1.0:1789185623.957141:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821827456 00000100:00100000:1.0:1789185623.957152:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821827456 00000100:00100000:1.0:1789185623.957171:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821827712 00000100:00100000:1.0:1789185623.957174:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821827712 00000100:00100000:1.0:1789185623.957190:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789185623.957197:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821827328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185623.957255:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821827328:12345-0@lo:400:kworker.0 Request processed in 59us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185623.957261:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789185623.957275:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789185623.957281:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821827456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185623.957308:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821827456:12345-0@lo:400:kworker.0 Request processed in 28us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185623.957313:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789185623.957325:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789185623.957330:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821827712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185623.957376:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821827712:12345-0@lo:400:kworker.0 Request processed in 33us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185623.957382:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1789185623.957437:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185623.957442:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185623.957463:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821827712:0@lo:400:kworker.0 00000100:00100000:3.0:1789185623.957572:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821827456:0@lo:400:kworker.0 00000100:00100000:3.0:1789185623.957582:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78026a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821827328:0@lo:400:kworker.0 00000040:00080000:3.0:1789185624.015730:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185624.015743:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185624.016296:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1789185624.016305:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789185624.208526:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185624.952148:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185624.952233:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812382208 00000100:00100000:1.0:1789185624.952243:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812382208 00000100:00100000:1.0:1789185624.952348:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 135 00000100:00100000:1.0:1789185624.952362:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:10257:x1876096812382208:12345-192.168.202.54@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789185624.952520:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:10257:x1876096812382208:12345-192.168.202.54@tcp:60:lhsmtool_posix.0 Request processed in 161us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185624.952558:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 135 00000100:00080000:2.0:1789185624.952715:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185624.963017:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185624.963472:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812382464 00000100:00100000:0.0:1789185624.963484:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812382464 00000100:00100000:0.0:1789185624.963552:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:0.0:1789185624.963563:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:10257:x1876096812382464:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789185624.963939:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:10257:x1876096812382464:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 376us (932us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789185624.963947:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:0.0:1789185624.975932:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185624.975958:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821827840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185624.976031:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185624.981445:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821827840 00000100:00100000:1.0:1789185624.981464:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821827840 00000100:00100000:1.0:1789185624.981549:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789185624.981560:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7938f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821827840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789185624.981613:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185624.981718:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7938f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821827840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (5685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185624.981724:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789185624.982462:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821827840:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789185625.232069:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185626.256280:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789185627.077672:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1789185627.077714:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1789185627.077729:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789185627.077739:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:3.0:1789185627.136387:0:12358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:00:24 (1789185624) 00010000:00010000:2.0:1789185627.279669:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185627.795545:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185627.795603:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185627.795642:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185627.795675:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185627.795703:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185627.795804:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812382592 00000100:00100000:0.0:1789185627.795815:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812382592 00000100:00100000:0.0:1789185627.795877:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 294 00000100:00100000:0.0:1789185627.795888:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812382592:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185627.795961:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812382592:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 74us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185627.795984:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 294 00000100:00100000:0.0:1789185627.796137:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812382720 00000100:00100000:0.0:1789185627.796141:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812382720 00000100:00100000:0.0:1789185627.796179:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812383104 00000100:00100000:0.0:1789185627.796182:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812383104 00000100:00100000:0.0:1789185627.796201:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 152 00000100:00100000:0.0:1789185627.796207:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:2370:x1876096812382720:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185627.796272:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 153 00000100:00100000:1.0:1789185627.796282:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812383104:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185627.796324:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812383104:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 45us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185627.796331:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 153 00000100:00100000:0.0:1789185627.796380:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:2370:x1876096812382720:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 172us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185627.796387:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 152 00000100:00080000:0.0:1789185627.796465:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185627.797613:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812382976 00000100:00100000:2.0:1789185627.797634:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812382976 00000100:00100000:2.0:1789185627.797798:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812382848 00000100:00100000:2.0:1789185627.797803:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812382848 00000100:00080000:0.0:1789185627.797862:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185627.797866:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185627.798006:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:1.0:1789185627.798019:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812382976:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185627.798052:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:3.0:1789185627.798116:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812382848:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185627.798132:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812382976:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 115us (2526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185627.798140:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:3.0:1789185627.798257:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812382848:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 195us (2581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185627.798266:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 71 00010000:00010000:2.0:1789185628.303711:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185629.054387:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185629.054612:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812383360 00000100:00100000:1.0:1789185629.054624:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812383360 00000100:00100000:1.0:1789185629.054702:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 136 00000100:00100000:1.0:1789185629.054714:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:11322:x1876096812383360:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185629.054750:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185629.054774:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c2b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d69b expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.054868:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c2c0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.054884:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c2c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.054899:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c2c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.054927:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c2c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.054935:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.054943:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.055587:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c2ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.055599:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c2ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.055607:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c2ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185629.055618:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789185629.055804:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c2c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.055813:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c2c0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.055819:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c2c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.055826:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185629.055833:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c2c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.055840:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c2c0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.055854:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c791aedc500) 00010000:00010000:1.0:1789185629.055857:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185629.055862:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c2c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.055868:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c2c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.055882:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.055888:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c2c7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.055895:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.056626:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4ce00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185629.056634:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.056644:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c2c7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.056658:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c791aedcb00) 00010000:00010000:1.0:1789185629.056661:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185629.056664:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c2c7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.056671:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c2c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789185629.057042:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789185629.057796:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c2b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d69b expref: 16 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.057818:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c2ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d69b expref: 15 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185629.057827:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c792334af00) 00010000:00010000:1.0:1789185629.057830:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185629.057834:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4c000, rc 0) 00000100:00100000:1.0:1789185629.058047:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:11322:x1876096812383360:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 3334us (3669us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789185629.058056:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 136 00000100:00100000:0.0:1789185629.070665:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185629.071080:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812383488 00000100:00100000:2.0:1789185629.071091:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812383488 00000100:00100000:2.0:1789185629.071175:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:2.0:1789185629.071188:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:2370:x1876096812383488:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185629.071211:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185629.071244:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c2ce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d69b expref: 15 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185629.071269:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c792334af00) 00010000:00010000:2.0:1789185629.071275:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185629.071356:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:2370:x1876096812383488:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 169us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185629.071364:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:0.0:1789185629.071820:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185629.072430:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812383616 00000100:00100000:3.0:1789185629.072436:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812383616 00000100:00100000:3.0:1789185629.072484:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 137 00000100:00100000:3.0:1789185629.072506:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:11322:x1876096812383616:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789185629.072585:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:11322:x1876096812383616:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 Request processed in 80us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185629.072593:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 137 00000100:00100000:2.0:1789185629.072705:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821828352:0@lo:400:kworker.0 00000100:00100000:2.0:1789185629.072750:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185629.072813:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789185629.072820:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821827968:0@lo:400:kworker.0 00000100:00100000:2.0:1789185629.072850:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185629.072873:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821828480:0@lo:400:kworker.0 00000100:00100000:2.0:1789185629.072896:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185629.073148:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821827968 00000100:00100000:2.0:1789185629.073154:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821827968 00000100:00100000:2.0:1789185629.073185:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789185629.073192:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821827968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185629.073249:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821827968:12345-0@lo:400:kworker.0 Request processed in 57us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185629.073256:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789185629.073299:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821827968:0@lo:400:kworker.0 00000100:00100000:2.0:1789185629.073325:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821828480 00000100:00100000:2.0:1789185629.073329:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821828480 00000100:00100000:2.0:1789185629.073367:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789185629.073374:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821828480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185629.073433:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821828480:12345-0@lo:400:kworker.0 Request processed in 60us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185629.073440:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789185629.073464:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821828480:0@lo:400:kworker.0 00000100:00080000:2.0:1789185629.073479:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185629.073502:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821828352 00000100:00100000:2.0:1789185629.073506:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821828352 00000100:00100000:2.0:1789185629.073537:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789185629.073544:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821828352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185629.073578:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821828352:12345-0@lo:400:kworker.0 Request processed in 34us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185629.073585:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789185629.073608:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821828352:0@lo:400:kworker.0 00000100:00080000:2.0:1789185629.073625:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185629.074040:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821828096:0@lo:400:kworker.0 00000100:00100000:1.0:1789185629.074088:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185629.074124:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821828608:0@lo:400:kworker.0 00000100:00100000:1.0:1789185629.074147:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185629.074165:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185629.074172:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821828224:0@lo:400:kworker.0 00000100:00100000:1.0:1789185629.074191:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185629.074222:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821828096 00000100:00100000:1.0:1789185629.074226:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821828096 00000100:00100000:1.0:1789185629.074253:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821828224 00000100:00100000:1.0:1789185629.074256:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821828224 00000100:00100000:1.0:1789185629.074280:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789185629.074286:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821828096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185629.074324:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821828096:12345-0@lo:400:kworker.0 Request processed in 37us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185629.074329:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789185629.074343:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789185629.074349:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821828224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185629.074377:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821828224:12345-0@lo:400:kworker.0 Request processed in 28us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185629.074381:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1789185629.074399:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185629.074446:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821828224:0@lo:400:kworker.0 00000100:00100000:1.0:1789185629.074456:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821828096:0@lo:400:kworker.0 00000100:00100000:2.0:1789185629.075990:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821828608 00000100:00100000:2.0:1789185629.076003:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821828608 00000100:00100000:2.0:1789185629.076078:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789185629.076088:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821828608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185629.076183:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821828608:12345-0@lo:400:kworker.0 Request processed in 96us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185629.076190:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1789185629.076334:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185629.076447:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821828608:0@lo:400:kworker.0 00000100:00100000:1.0:1789185629.077289:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821828736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185629.077353:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185629.078011:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821828736 00000100:00100000:3.0:1789185629.078019:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821828736 00000100:00100000:3.0:1789185629.078074:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789185629.078084:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821828736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185629.078125:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185629.078188:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821828736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185629.078195:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789185629.078339:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821828736:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1789185629.136053:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185629.136063:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185629.139474:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789185629.139506:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789185629.331901:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185630.115524:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821828864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185630.115597:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185630.115675:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821828864 00000100:00100000:3.0:1789185630.115682:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821828864 00000100:00100000:3.0:1789185630.115729:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789185630.115738:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821828864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185630.115788:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185630.115839:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821828864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185630.115847:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789185630.115897:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821828864:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789185630.352570:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185631.355135:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185631.355319:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812383744 00000100:00100000:1.0:1789185631.355329:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812383744 00000100:00100000:1.0:1789185631.355431:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 138 00000100:00100000:1.0:1789185631.355443:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:11365:x1876096812383744:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789185631.355464:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185631.355495:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c2dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d6a2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.355697:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c2e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.355714:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c2e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.355885:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c2e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.355904:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c2ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.355912:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c2ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.355918:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c2ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789185631.356256:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789185631.356351:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c2e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.356372:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c2e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.356379:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c2e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.356386:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4ca00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185631.356390:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c2e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.356398:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c2e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.356519:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:1.0:1789185631.356522:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185631.357203:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c2e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.357216:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c2e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.357230:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c2ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.357237:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c2ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.357243:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c2ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.357249:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185631.357259:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c2ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.357266:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c2ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.357276:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c791aedc700) 00010000:00010000:1.0:1789185631.357279:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185631.357282:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c2ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.357288:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c2ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.357335:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c2dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6a2 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.357345:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:1.0:1789185631.357347:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185631.357351:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c2dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6a2 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.357359:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4d600, rc 0) 00000100:00100000:1.0:1789185631.358833:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:11365:x1876096812383744:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 3383us (3704us total) trans 0 rc 301/301 00000100:00100000:1.0:1789185631.358845:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 138 00010000:00010000:1.0:1789185631.377759:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185631.397056:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185631.397138:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812384000 00000100:00100000:3.0:1789185631.397148:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812384000 00000100:00100000:3.0:1789185631.397206:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 139 00000100:00100000:3.0:1789185631.397217:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:11365:x1876096812384000:12345-192.168.202.54@tcp:36:lfs.0 00010000:00010000:3.0:1789185631.397272:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185631.397494:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272bc68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4e2 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.397515:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c791aedc600) 00010000:00010000:3.0:1789185631.397601:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185631.397826:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c2f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.397914:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c2f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.397927:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c2f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.397943:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2f8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.397957:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.397965:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185631.404934:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789185631.404957:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c2f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.405120:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c2f1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.405130:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c2f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.405137:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185631.405142:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c2f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.405152:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c2f1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.405170:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79055dd700) 00010000:00010000:3.0:1789185631.405173:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185631.405178:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c2f1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.405184:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c2f1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185631.405227:0:11024:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a102c7ff reply state 000000001c19dacd transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185631.405237:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789185631.405770:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:11365:x1876096812384000:12345-192.168.202.54@tcp:36:lfs.0 Request processed in 8550us (8716us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789185631.405780:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 139 00010000:00010000:3.0:1789185631.419055:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.419074:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2f8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.419083:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2f8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.419089:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185631.419094:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2f8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.419111:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2f8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.419128:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c79055dd800) 00010000:00010000:3.0:1789185631.419131:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185631.419137:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2f8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.419142:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c2f8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185631.530749:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185631.530794:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812384128 00000100:00100000:2.0:1789185631.530804:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812384128 00000100:00100000:2.0:1789185631.530854:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 140 00000100:00100000:2.0:1789185631.530864:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:11373:x1876096812384128:12345-192.168.202.54@tcp:101:lctl.0 00010000:00010000:2.0:1789185631.530887:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185631.530911:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c2ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d6a9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.530978:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c306 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.530993:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.531006:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185631.531042:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789185631.531046:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789185631.531086:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.531114:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c2ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6a9 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.531150:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c306 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6a9 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.531160:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334a200) 00010000:00010000:2.0:1789185631.531163:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185631.531166:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7000, rc 0) 00000100:00100000:2.0:1789185631.531222:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:11373:x1876096812384128:12345-192.168.202.54@tcp:101:lctl.0 Request processed in 359us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185631.531230:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 140 00000100:00100000:1.0:1789185631.622662:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185631.622703:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812384256 00000100:00100000:2.0:1789185631.622721:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812384256 00000100:00100000:2.0:1789185631.622797:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 141 00000100:00100000:2.0:1789185631.622808:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+15:11378:x1876096812384256:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789185631.622827:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185631.622857:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c30d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d6b0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.622927:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c314 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.622942:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c314 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.622954:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c314 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.622968:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c31b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.622990:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c31b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.622997:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c31b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623105:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffa00/0x532743011272c322 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623115:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffa00/0x532743011272c322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623122:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffa00/0x532743011272c322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185631.623151:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789185631.623155:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789185631.623172:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffa00/0x532743011272c322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623184:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c314 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623191:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c314 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623197:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c314 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623202:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185631.623207:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c314 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623222:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c314 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623233:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334a200) 00010000:00010000:2.0:1789185631.623237:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185631.623243:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c314 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623249:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6200/0x532743011272c314 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623262:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c31b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623761:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c31b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623780:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c31b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623787:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185631.623791:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c31b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623797:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c31b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623806:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c792334ae00) 00010000:00010000:2.0:1789185631.623809:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185631.623812:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c31b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623830:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7600/0x532743011272c31b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623875:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272c30d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6b0 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623890:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffa00/0x532743011272c322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6b0 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.623898:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:2.0:1789185631.623901:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789185631.623903:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073ffa00, rc 0) 00000100:00100000:2.0:1789185631.623971:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:11378:x1876096812384256:12345-192.168.202.54@tcp:101:bash.0 Request processed in 1164us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185631.623979:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 141 00000100:00100000:3.0:1789185631.641946:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185631.642080:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812384512 00000100:00100000:2.0:1789185631.642099:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812384512 00000100:00100000:2.0:1789185631.642179:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 142 00000100:00100000:2.0:1789185631.642192:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+16:11378:x1876096812384512:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789185631.642214:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185631.642248:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c329 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d6b7 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.642379:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe000/0x532743011272c330 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.642395:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe000/0x532743011272c330 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.642477:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe000/0x532743011272c330 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.642514:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c337 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.642523:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c337 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.642531:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c337 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789185631.643125:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789185631.643286:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c33e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.643296:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.643305:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.643339:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe000/0x532743011272c330 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.643346:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe000/0x532743011272c330 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.643352:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe000/0x532743011272c330 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.643358:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fe000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185631.643369:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe000/0x532743011272c330 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.643377:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe000/0x532743011272c330 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.643389:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:2.0:1789185631.643393:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185631.643397:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe000/0x532743011272c330 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.643427:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe000/0x532743011272c330 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185631.643440:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008154d46d reply state 00000000bba821dc transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c337 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185631.643449:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789185631.643492:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c329 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6b7 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.643507:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c33e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6b7 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.643514:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a600) 00010000:00010000:2.0:1789185631.643517:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185631.643519:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073ff600, rc 0) 00000100:00100000:2.0:1789185631.643593:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:11378:x1876096812384512:12345-192.168.202.54@tcp:101:bash.0 Request processed in 1404us (1663us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1789185631.643601:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 142 00010000:00010000:2.0:1789185631.648246:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c337 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.648265:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c337 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.648275:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c337 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.648282:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073ffe00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185631.648287:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c337 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.648297:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c337 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.648316:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c792334ae00) 00010000:00010000:2.0:1789185631.648319:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185631.648325:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c337 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.648332:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c337 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185631.652935:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185631.653030:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812384640 00000100:00100000:2.0:1789185631.653041:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812384640 00000100:00100000:2.0:1789185631.653130:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:2.0:1789185631.653145:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2371:x1876096812384640:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789185631.653167:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185631.653188:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9ed302e/0x532743011272c34c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d6be expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789185631.653243:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789185631.653246:0:6884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185631.653274:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=328s v=(0 0) 00010000:00010000:2.0:1789185631.653279:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185631.653291:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9ed302e/0x532743011272c34c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6be expref: 6 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.653310:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9ed302e/0x532743011272c34c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6be expref: 6 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.653324:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073ff800, rc 0) 00000100:00100000:2.0:1789185631.653397:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2371:x1876096812384640:12345-192.168.202.54@tcp:101:bash.0 Request processed in 256us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185631.653442:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:0.0:1789185631.657648:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185631.658226:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812384768 00000100:00100000:2.0:1789185631.658238:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812384768 00000100:00100000:2.0:1789185631.658307:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:2.0:1789185631.658318:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:11378:x1876096812384768:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789185631.658340:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185631.658360:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d6c5 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.658395:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9ed302e/0x532743011272c34c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6be expref: 7 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.658457:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185631.658473:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185631.658482:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.658521:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9ed302e/0x532743011272c34c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6be expref: 7 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.658539:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9ed302e/0x532743011272c34c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6be expref: 7 pid: 6884 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185631.658554:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f1a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1876096821828992:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185631.658665:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906b2e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789185631.661349:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f1a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1876096821828992:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789185631.661391:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.661442:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073fe600, rc 0) 00000100:00100000:2.0:1789185631.661530:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:11378:x1876096812384768:12345-192.168.202.54@tcp:101:bash.0 Request processed in 3213us (3891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185631.661539:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:3.0:1789185631.662965:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185631.663083:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812384896 00000100:00100000:1.0:1789185631.663096:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812384896 00010000:00010000:1.0:1789185631.663177:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9ed302e/0x532743011272c34c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6be expref: 7 pid: 6884 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185631.663222:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:1.0:1789185631.663232:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2371:x1876096812384896:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185631.663251:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185631.663279:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9ed302e/0x532743011272c34c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6be expref: 7 pid: 6884 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.663298:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9ed302e/0x532743011272c34c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6be expref: 7 pid: 6884 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.663327:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9ed302e/0x532743011272c34c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6be expref: 7 pid: 6884 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.663533:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185631.663540:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185631.663550:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.663572:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.663621:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185631.663651:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5809:1876096821829120:192.168.202.54@tcp:105: 00000100:00100000:1.0:1789185631.663746:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185631.670148:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185631.670278:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5809:1876096821829120:192.168.202.54@tcp:105: 00000100:00100000:2.0:1789185631.670280:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812385152 00000100:00100000:2.0:1789185631.670296:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812385152 00010000:00010000:1.0:1789185631.670323:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185631.670368:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:2.0:1789185631.670455:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+18:11378:x1876096812385152:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:2.0:1789185631.670840:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:11378:x1876096812385152:12345-192.168.202.54@tcp:35:bash.0 Request processed in 441us (703us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789185631.670862:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:1.0:1789185631.673749:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2371:x1876096812384896:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 10501us (10780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185631.673769:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:0.0:1789185631.783194:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185631.783305:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812385408 00000100:00100000:3.0:1789185631.783319:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812385408 00000100:00100000:3.0:1789185631.783454:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 143 00000100:00100000:3.0:1789185631.783477:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:11389:x1876096812385408:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185631.783511:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185631.783540:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c35a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d6cc expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185631.783668:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789185631.783834:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c35a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6cc expref: 21 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.783852:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334a200) 00010000:00010000:3.0:1789185631.783855:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185631.783863:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c35a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6cc expref: 21 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.783881:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05200, rc 0) 00000100:00100000:3.0:1789185631.783964:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:11389:x1876096812385408:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 500us (785us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1789185631.783972:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 143 00000100:00100000:2.0:1789185631.788141:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185631.788272:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812385664 00000100:00100000:1.0:1789185631.788285:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812385664 00000100:00100000:1.0:1789185631.788552:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:1.0:1789185631.788578:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:11389:x1876096812385664:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1789185631.788902:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:11389:x1876096812385664:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 329us (783us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789185631.788911:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:0.0:1789185631.876489:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185631.876673:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812385792 00000100:00100000:2.0:1789185631.876686:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812385792 00000100:00100000:2.0:1789185631.876768:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 144 00000100:00100000:2.0:1789185631.876782:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:11395:x1876096812385792:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185631.876813:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185631.876841:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff400/0x532743011272c368 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d6d3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.876931:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fec00/0x532743011272c36f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.876948:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fec00/0x532743011272c36f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.876963:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fec00/0x532743011272c36f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185631.877009:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789185631.877013:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789185631.877037:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fec00/0x532743011272c36f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.877070:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff400/0x532743011272c368 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6d3 expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.877270:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fec00/0x532743011272c36f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6d3 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.877281:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:2.0:1789185631.877285:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185631.877290:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073fec00, rc 0) 00000100:00100000:2.0:1789185631.877377:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+22:11395:x1876096812385792:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 598us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185631.877386:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 144 00000100:00100000:2.0:1789185631.885751:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185631.885912:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812386048 00000100:00100000:3.0:1789185631.885942:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812386048 00000100:00100000:3.0:1789185631.886043:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 145 00000100:00100000:3.0:1789185631.886057:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+22:11395:x1876096812386048:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185631.886086:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185631.886134:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c376 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d6da expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.886278:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c37d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.886296:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c37d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.886309:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c37d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185631.886321:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789185631.886535:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c376 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6da expref: 25 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.886572:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c37d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6da expref: 24 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.886582:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a600) 00010000:00010000:3.0:1789185631.886585:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185631.886589:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05400, rc 0) 00000100:00100000:3.0:1789185631.886671:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+24:11395:x1876096812386048:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 617us (936us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1789185631.886679:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 145 00000100:00100000:2.0:1789185631.892325:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185631.892366:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185631.892453:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812386432 00000100:00100000:1.0:1789185631.892476:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812386432 00000100:00100000:1.0:1789185631.892570:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1789185631.892584:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+24:2369:x1876096812386432:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185631.892606:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185631.892642:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c37d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6da expref: 24 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.892666:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a600) 00010000:00010000:1.0:1789185631.892693:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185631.892768:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+23:2369:x1876096812386432:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 187us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185631.892777:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:3.0:1789185631.893442:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812386304 00000100:00100000:3.0:1789185631.893451:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812386304 00000100:00100000:3.0:1789185631.893509:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 146 00000100:00100000:3.0:1789185631.893518:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+23:11395:x1876096812386304:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185631.893545:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185631.893621:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c38b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d6e1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.893752:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c392 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.893771:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.893785:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185631.893931:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789185631.894091:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c38b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6e1 expref: 26 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.894744:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c392 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6e1 expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.894757:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a600) 00010000:00010000:3.0:1789185631.894760:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789185631.894764:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05a00, rc 0) 00000100:00100000:3.0:1789185631.895080:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+25:11395:x1876096812386304:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1560us (2765us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1789185631.895130:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 146 00000100:00100000:2.0:1789185631.904447:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185631.904564:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812386560 00000100:00100000:1.0:1789185631.904577:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812386560 00000100:00100000:1.0:1789185631.904653:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:1.0:1789185631.904666:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2371:x1876096812386560:12345-192.168.202.54@tcp:1:lfs.0 00010000:00010000:1.0:1789185631.904724:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272c3a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.904750:0:6884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.904761:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185631.904766:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185631.904771:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272c3a0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.904832:0:6884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.904850:0:6884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 6 pid: 6676 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185631.904868:0:6884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6884:1876096821829248:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789185631.904984:0:6884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185631.909396:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185631.909617:0:6884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6884:1876096821829248:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789185631.909659:0:6884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272c3a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185631.909818:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812386688 00000100:00100000:3.0:1789185631.909828:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812386688 00002000:00100000:3.0:1789185631.909895:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9c7907d01180 x1876096812386688/t0(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:232/0 lens 504/0 e 0 to 0 dl 1789185642 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789185631.909907:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7907d01180 with x1876096812386688 ext(0->12) 00010000:00010000:3.0:1789185631.909916:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 7 pid: 6676 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.909934:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 7 pid: 6676 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789185631.909943:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c7907d01180 00000100:00100000:3.0:1789185631.909985:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:3.0:1789185631.909998:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2371:x1876096812386688:12345-192.168.202.54@tcp:4:lfs.0 00000100:00100000:3.0:1789185631.911145:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2371:x1876096812386688:12345-192.168.202.54@tcp:4:lfs.0 Request processed in 1139us (1753us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789185631.911158:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00002000:00100000:3.0:1789185631.911170:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9c7907d01180 x1876096812386688/t4294967305(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:232/0 lens 504/448 e 0 to 0 dl 1789185642 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789185631.911181:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7907d01180 with x1876096812386688 ext(0->12) 00010000:00010000:3.0:1789185631.911190:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 9 pid: 6676 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185631.911224:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 9 pid: 6676 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789185631.911233:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c7907d01180 00000100:00100000:3.0:1789185631.914551:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185631.914745:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812386816 00000100:00100000:0.0:1789185631.914758:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812386816 00010000:00010000:0.0:1789185631.914810:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 9 pid: 6676 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185631.914911:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:0.0:1789185631.914942:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2371:x1876096812386816:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185631.914961:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789185631.914985:0:5808:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789185631.914988:0:5808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789185630 00002000:00010000:0.0:1789185631.914991:0:5808:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789185631 00002000:00010000:0.0:1789185631.914993:0:5808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789185630 00010000:00010000:0.0:1789185631.915000:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 9 pid: 6676 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185631.915019:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 9 pid: 6676 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185631.915049:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c324d6e4/0x532743011272c353 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6c5 expref: 9 pid: 6676 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185631.915073:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789185631.915078:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789185631.915085:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272c3a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185631.915107:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272c3a0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185631.915268:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185631.915344:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2371:x1876096812386816:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 405us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185631.915352:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00010000:00010000:2.0:1789185631.915440:0:6884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272c3a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.915451:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272c3a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.915493:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272c3a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.915503:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272c3a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.915525:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272c3a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.915533:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4ca00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185631.915537:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272c3a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.915548:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272c3a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.915575:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272c3a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.915585:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272c3a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185631.915655:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2371:x1876096812386560:12345-192.168.202.54@tcp:1:lfs.0 Request processed in 10992us (11271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185631.915665:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:2.0:1789185631.918162:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185631.918525:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812387072 00000100:00100000:1.0:1789185631.918539:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812387072 00000100:00100000:1.0:1789185631.918793:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:1.0:1789185631.918806:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791916ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+25:11395:x1876096812387072:12345-192.168.202.54@tcp:35:lfs.0 00000004:00010000:1.0:1789185631.918901:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c392 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6e1 expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185631.919533:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1789185631.919703:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789185631.920823:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1789185631.920916:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c3a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.920944:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c33e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6b7 expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.920954:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c3a7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.921004:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c33e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6b7 expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.921028:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c33e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6b7 expref: 29 pid: 5824 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185631.921066:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1876096821829376:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789185631.921394:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee180 going to sleep for 11 seconds 00000100:00100000:3.0:1789185631.925966:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185631.926065:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812387200 00000100:00100000:2.0:1789185631.926078:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812387200 00010000:00010000:2.0:1789185631.926153:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c33e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6b7 expref: 30 pid: 5824 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185631.926232:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:2.0:1789185631.926244:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+30:2371:x1876096812387200:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185631.926267:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185631.926275:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c33e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6b7 expref: 30 pid: 5824 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.926292:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c33e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6b7 expref: 30 pid: 5824 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.926320:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a600) 00010000:00010000:2.0:1789185631.926327:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c3a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.926338:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c3a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.926347:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c3a7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.926371:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185631.926477:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+30:2371:x1876096812387200:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 235us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185631.926486:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 62 00010000:00010000:1.0:1789185631.928005:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c33e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6b7 expref: 29 pid: 5824 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185631.928046:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1876096821829376:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789185631.928080:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c3a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.928104:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c3a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185631.928111:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c3a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185631.928299:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1789185631.928845:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1789185631.929015:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936db9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876096821829504:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789185631.929109:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185631.929623:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185631.929740:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821829504 00000100:00100000:0.0:1789185631.929751:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821829504 00000100:00100000:0.0:1789185631.929885:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789185631.929898:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1876096821829504:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789185631.930023:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1876096821829504:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 127us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185631.930032:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789185631.930220:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936db9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876096821829504:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789185631.931040:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1789185631.931296:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b30a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876096821829632:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789185631.931372:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185631.931771:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906b2e540 going to sleep for 11 seconds 00000100:00100000:0.0:1789185631.931884:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821829632 00000100:00100000:0.0:1789185631.931895:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821829632 00000100:00100000:0.0:1789185631.931963:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789185631.931976:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1876096821829632:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789185631.932253:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5826:x1876096821829632:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 279us (880us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789185631.932262:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789185631.932641:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b30a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876096821829632:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789185631.932742:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1789185631.932812:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c3a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.932826:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c3a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.932835:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c3a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.932843:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185631.932849:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c3a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.932860:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c3a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.932883:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a600) 00010000:00010000:2.0:1789185631.932887:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789185631.932895:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c3a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.932903:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c3a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789185631.933313:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789185631.933554:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1789185631.933568:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328973162104ns, next at 329973159449ns, rc = 0 00000001:00080000:2.0:1789185631.933594:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1789185631.933640:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a600) 00010000:00010000:2.0:1789185631.933645:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789185631.933655:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c392 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6e1 expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185631.933889:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791916ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:11395:x1876096812387072:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 15084us (15738us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1789185631.933902:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00000020:00080000:2.0:1789185631.933908:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1789185631.934128:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185631.937610:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185631.937715:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812387328 00000100:00100000:2.0:1789185631.937730:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812387328 00000100:00100000:2.0:1789185631.937857:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 147 00000100:00100000:2.0:1789185631.937871:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:11395:x1876096812387328:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185631.937905:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185631.937937:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe400/0x532743011272c3ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d6e8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.938024:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe400/0x532743011272c3ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6e8 expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.938043:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe400/0x532743011272c3ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6e8 expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185631.938068:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:2.0:1789185631.938072:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185631.938077:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073fe400, rc 0) 00000100:00100000:2.0:1789185631.938246:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+33:11395:x1876096812387328:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 377us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185631.938273:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 147 00000100:00100000:1.0:1789185631.941997:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185631.942215:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812387584 00000100:00100000:2.0:1789185631.942230:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812387584 00000100:00100000:2.0:1789185631.942337:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:2.0:1789185631.942351:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+33:11395:x1876096812387584:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1789185631.942887:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+34:11395:x1876096812387584:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 534us (905us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789185631.942898:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:0.0:1789185632.053201:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185632.053487:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812387840 00000100:00100000:2.0:1789185632.053503:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812387840 00000100:00100000:2.0:1789185632.054304:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 148 00000100:00100000:2.0:1789185632.054324:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+34:11405:x1876096812387840:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185632.054361:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185632.054392:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fee00/0x532743011272c3b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d6ef expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185632.054556:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789185632.054744:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fee00/0x532743011272c3b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6ef expref: 36 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.054761:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334a200) 00010000:00010000:2.0:1789185632.054765:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185632.054772:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fee00/0x532743011272c3b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6ef expref: 36 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.054800:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073fee00, rc 0) 00000100:00100000:2.0:1789185632.054919:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:11405:x1876096812387840:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 603us (1734us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1789185632.054929:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 148 00000100:00100000:1.0:1789185632.059540:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185632.059893:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812387968 00000100:00100000:3.0:1789185632.059907:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812387968 00000100:00100000:3.0:1789185632.060005:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 149 00000100:00100000:3.0:1789185632.060018:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:11405:x1876096812387968:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:3.0:1789185632.060134:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060154:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060172:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060188:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060195:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060201:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060332:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060342:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060349:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185632.060400:0:11024:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060442:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060450:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060458:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060476:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185632.060480:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060489:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060503:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:3.0:1789185632.060506:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185632.060512:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060525:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060542:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060548:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060554:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060695:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185632.060699:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060706:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060714:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c79055dd800) 00010000:00010000:3.0:1789185632.060716:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185632.060719:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060724:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060740:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060747:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060762:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060767:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185632.060770:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060776:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060784:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:3.0:1789185632.060786:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185632.060798:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.060804:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185632.060980:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:11405:x1876096812387968:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 961us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185632.060990:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 149 00000100:00100000:0.0:1789185632.064246:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185632.064331:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812388224 00000100:00100000:1.0:1789185632.064346:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812388224 00000100:00100000:1.0:1789185632.064509:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:1.0:1789185632.064523:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:11405:x1876096812388224:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1789185632.065032:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:11405:x1876096812388224:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 509us (800us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789185632.065042:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:0.0:1789185632.136614:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185632.137841:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812388480 00000100:00100000:3.0:1789185632.137863:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812388480 00000100:00100000:3.0:1789185632.137966:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 150 00000100:00100000:3.0:1789185632.137980:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:11408:x1876096812388480:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185632.138014:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185632.138044:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c3d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d6f6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138184:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3df lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138202:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138217:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138237:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138245:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138253:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138472:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138483:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138490:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185632.138502:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789185632.138623:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138632:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138647:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138654:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185632.138659:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138668:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138682:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:3.0:1789185632.138686:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185632.138691:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138698:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c3df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138713:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138720:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138726:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138732:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185632.138735:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138750:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138757:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c79055dd800) 00010000:00010000:3.0:1789185632.138759:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185632.138762:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138767:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c3e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138818:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c3d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6f6 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138833:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6f6 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.138840:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:3.0:1789185632.138842:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185632.138844:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05000, rc 0) 00000100:00100000:3.0:1789185632.138933:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:11408:x1876096812388480:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 956us (2333us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789185632.138943:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 150 00000100:00100000:3.0:1789185632.161974:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185632.162010:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812388608 00000100:00100000:3.0:1789185632.162020:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812388608 00000100:00100000:3.0:1789185632.162071:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 151 00000100:00100000:3.0:1789185632.162082:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:11408:x1876096812388608:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:3.0:1789185632.162164:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c3fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.162182:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.162194:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.162221:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.162228:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c3fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.162234:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c3fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.162240:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185632.162244:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c3fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.164633:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c3fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.164668:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:3.0:1789185632.164673:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185632.164679:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c3fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.164688:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c3fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185632.164821:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:11408:x1876096812388608:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 2736us (2850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185632.164833:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 151 00000100:00100000:0.0:1789185632.170957:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185632.171478:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812388864 00000100:00100000:3.0:1789185632.171497:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812388864 00000100:00100000:3.0:1789185632.171579:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:3.0:1789185632.171592:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:11408:x1876096812388864:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789185632.172973:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+39:11408:x1876096812388864:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 1377us (2024us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789185632.172986:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 41 00000001:00080000:0.0:1789185632.248893:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000004:00080000:0.0:1789185632.249549:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789185632.249715:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c7906b2e180 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789185632.249723:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c79103a6900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c7906b2e600 00000020:00080000:0.0:1789185632.249727:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c79103a6b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c793f262400 00000001:00080000:0.0:1789185632.249762:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967437 is committed 00000020:00080000:2.0:1789185632.249805:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:1.0:1789185632.250394:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821829760:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789185632.250534:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1789185632.250670:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789185632.250692:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821829760 00000100:00100000:0.0:1789185632.250705:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821829760 00000100:00100000:0.0:1789185632.250779:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789185632.250811:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1876096821829760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789185632.250850:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1789185632.250903:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa4ce5e, atime: 0x6aa4ce5f, ctime: 0x6aa4ce5e, blocks: 0x1 00010000:00010000:0.0:1789185632.250914:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062bdd6bd/0x532743011272c402 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185632.250938:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1789185632.250943:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185632.250952:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062bdd6bd/0x532743011272c402 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185632.250973:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062bdd6bd/0x532743011272c402 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185632.250986:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062bdd6bd/0x532743011272c402 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185632.250996:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062bdd6bd/0x532743011272c402 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185632.251022:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789185632.255980:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3279:x1876096821829760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5160us (5444us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789185632.255998:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1789185632.256046:0:11163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185632.256056:0:11163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062bdd6bd/0x532743011272c402 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185632.256096:0:11163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354600 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185632.256101:0:11163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062bdd6bd/0x532743011272c402 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185632.256113:0:11163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062bdd6bd/0x532743011272c402 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185632.258027:0:11163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062bdd6bd/0x532743011272c402 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185632.258037:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062bdd6bd/0x532743011272c402 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185632.258075:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185632.258078:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185632.258081:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789185632.258293:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c793f129c00/2, rc 0, transno 4294967307 00000100:00100000:1.0:1789185632.258306:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821829760:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789185632.402268:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185632.445908:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185632.449760:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812389120 00000100:00100000:1.0:1789185632.449777:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812389120 00000100:00100000:1.0:1789185632.449865:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 152 00000100:00100000:1.0:1789185632.449876:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+18:11439:x1876096812389120:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:1.0:1789185632.449901:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185632.449922:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c409 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d6fd expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185632.450035:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c410 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185632.450050:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185632.450062:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185632.450072:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789185632.450713:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c409 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6fd expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185632.450759:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6fd expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185632.450769:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:1.0:1789185632.450773:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185632.450776:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4d400, rc 0) 00000100:00100000:1.0:1789185632.450925:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:11439:x1876096812389120:12345-192.168.202.54@tcp:101:cat.0 Request processed in 1049us (5029us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789185632.450934:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 152 00000100:00100000:0.0:1789185632.457721:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185632.458087:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812389248 00000100:00100000:1.0:1789185632.458368:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812389248 00000100:00100000:1.0:1789185632.458621:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:1.0:1789185632.458633:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:2372:x1876096812389248:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185632.458651:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185632.458678:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c410 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6fd expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185632.458701:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:1.0:1789185632.458708:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185632.458767:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:2372:x1876096812389248:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 137us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185632.458774:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:3.0:1789185632.459046:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185632.459136:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812389504 00000100:00100000:3.0:1789185632.459141:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812389504 00000100:00100000:3.0:1789185632.459171:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:3.0:1789185632.459179:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:11439:x1876096812389504:12345-192.168.202.54@tcp:35:cat.0 00000100:00100000:3.0:1789185632.459518:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:11439:x1876096812389504:12345-192.168.202.54@tcp:35:cat.0 Request processed in 338us (471us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789185632.459526:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:3.0:1789185632.510296:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185632.510447:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812389760 00000100:00100000:1.0:1789185632.510466:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812389760 00000100:00100000:2.0:1789185632.510627:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 153 00000100:00100000:2.0:1789185632.510643:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:11445:x1876096812389760:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:2.0:1789185632.510673:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185632.510676:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789185632.510701:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fec00/0x532743011272c36f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6d3 expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.510719:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:2.0:1789185632.510724:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185632.510736:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fee00/0x532743011272c41e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d704 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.510823:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.510844:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6f6 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.510854:0:11024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.510886:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6f6 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.510920:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6f6 expref: 20 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185632.510934:0:11024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1876096821829888:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185632.511020:0:11024:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c792f6a1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185632.514896:0:11024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1876096821829888:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185632.514930:0:11024:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185632.519298:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185632.519578:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812389888 00000100:00100000:2.0:1789185632.519594:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812389888 00010000:00010000:2.0:1789185632.519655:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6f6 expref: 21 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185632.519704:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:2.0:1789185632.519716:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793081ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:2372:x1876096812389888:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185632.519735:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185632.519743:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6f6 expref: 21 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.519760:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6f6 expref: 21 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.519784:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c3ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6f6 expref: 21 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.519807:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:2.0:1789185632.519813:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.519859:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.519869:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.519916:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185632.520002:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793081ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:2372:x1876096812389888:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 288us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185632.520010:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 63 00010000:00010000:0.0:1789185632.520784:0:11024:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185632.520797:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185632.520816:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789185632.521005:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fee00/0x532743011272c41e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d704 expref: 21 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185632.521577:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d704 expref: 20 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185632.521588:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:0.0:1789185632.521591:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789185632.521596:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073fe800, rc 0) 00000100:00100000:0.0:1789185632.521709:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:11445:x1876096812389760:12345-192.168.202.54@tcp:101:dd.0 Request processed in 11071us (11422us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789185632.521718:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 153 00000100:00100000:0.0:1789185632.526756:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185632.526876:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812390144 00000100:00100000:1.0:1789185632.526917:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812390144 00000100:00100000:1.0:1789185632.527004:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 154 00000100:00100000:1.0:1789185632.527016:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:11445:x1876096812390144:12345-192.168.202.54@tcp:36:dd.0 00010000:00010000:1.0:1789185632.527698:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c433 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185632.527722:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185632.527736:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185632.527851:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1789185632.527881:0:5822:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b1ed3d6b reply state 000000000adaf4cf transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185632.527893:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789185632.528683:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+23:11445:x1876096812390144:12345-192.168.202.54@tcp:36:dd.0 Request processed in 1016us (1286us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1789185632.528696:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 154 00000020:00080000:1.0:1789185632.528704:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789185632.531300:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.531322:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c433 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.531330:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c433 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.531338:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185632.531344:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c433 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.531354:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c433 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.531376:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:3.0:1789185632.531380:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185632.531386:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c433 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.531393:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c433 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185632.733749:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185632.734445:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812390272 00000100:00100000:3.0:1789185632.734467:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812390272 00000100:00100000:3.0:1789185632.734532:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 155 00000100:00100000:3.0:1789185632.734544:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+22:11459:x1876096812390272:12345-192.168.202.54@tcp:101:stat.0 00010000:00010000:3.0:1789185632.734571:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185632.734608:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c43a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d70b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.734681:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c441 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.734699:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c441 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.734712:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c441 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.734729:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c448 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.734736:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.734743:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.735064:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c44f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.735077:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d704 expref: 23 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.735214:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c44f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.735253:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d704 expref: 23 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.735282:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d704 expref: 23 pid: 11024 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185632.735296:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876096821830016:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185632.735430:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78039a6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789185632.743920:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185632.746681:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876096821830016:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185632.746709:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c44f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185632.746840:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812390528 00000100:00100000:0.0:1789185632.746849:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812390528 00000100:00100000:0.0:1789185632.746914:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:0.0:1789185632.746923:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+24:5611:x1876096812390528:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789185632.747289:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+25:5611:x1876096812390528:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 364us (3378us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1789185632.747297:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:0.0:1789185632.751596:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185632.754183:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812390656 00000100:00100000:3.0:1789185632.754211:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812390656 00010000:00010000:3.0:1789185632.754272:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d704 expref: 25 pid: 11024 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185632.754320:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:3.0:1789185632.754331:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+25:2372:x1876096812390656:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185632.754347:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185632.754354:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d704 expref: 25 pid: 11024 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.754371:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d704 expref: 25 pid: 11024 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.754395:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c425 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d704 expref: 25 pid: 11024 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.754474:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:3.0:1789185632.754480:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c44f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.754490:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c44f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.754497:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c44f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185632.754530:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185632.754604:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+24:2372:x1876096812390656:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 273us (3017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185632.754611:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 64 00010000:00010000:2.0:1789185632.755399:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c44f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755433:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c44f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185632.755489:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789185632.755494:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789185632.755523:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c44f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755538:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c44f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755548:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c441 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755555:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c441 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755576:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c441 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755582:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185632.755586:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c441 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755593:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c441 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755605:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:2.0:1789185632.755609:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185632.755613:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c441 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755619:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c441 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755631:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755636:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c448 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755642:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c448 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755646:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185632.755649:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c448 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755664:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c448 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755673:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c79055dd800) 00010000:00010000:2.0:1789185632.755676:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185632.755679:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c448 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755684:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c448 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755729:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c43a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d70b expref: 24 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755745:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c44f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d70b expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.755752:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:2.0:1789185632.755754:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185632.755756:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04200, rc 0) 00000100:00100000:2.0:1789185632.755810:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+23:11459:x1876096812390272:12345-192.168.202.54@tcp:101:stat.0 Request processed in 21267us (22071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185632.755818:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 155 00000100:00100000:0.0:1789185632.841339:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185632.841440:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812390912 00000100:00100000:2.0:1789185632.841450:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812390912 00000100:00100000:2.0:1789185632.841527:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 156 00000100:00100000:2.0:1789185632.841539:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+23:11465:x1876096812390912:12345-192.168.202.54@tcp:36:truncate.0 00010000:00010000:2.0:1789185632.841621:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185632.841654:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c44f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d70b expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.841677:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:2.0:1789185632.841682:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185632.841913:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c456 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.841927:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.841937:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185632.842309:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1789185632.842340:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000739c2a1b reply state 000000004347484b transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185632.842349:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185632.842519:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+25:11465:x1876096812390912:12345-192.168.202.54@tcp:36:truncate.0 Request processed in 980us (1188us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789185632.842527:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 156 00000020:00080000:2.0:1789185632.842533:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789185632.849103:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.849120:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c456 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.849129:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c456 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.849153:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fe200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185632.849159:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c456 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.849167:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c456 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.849183:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:2.0:1789185632.849186:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185632.849192:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c456 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185632.849198:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c456 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185632.908764:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185632.908817:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185632.908852:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185632.908894:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185632.908930:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812391424 00000100:00100000:0.0:1789185632.908964:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812391424 00000100:00100000:0.0:1789185632.909024:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 157 00000100:00100000:0.0:1789185632.909034:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812391424:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185632.909089:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812391296 00000100:00100000:3.0:1789185632.909103:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812391296 00000100:00100000:0.0:1789185632.909114:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812391424:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185632.909123:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 157 00000100:00080000:0.0:1789185632.909155:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185632.909160:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185632.909286:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812391168 00000100:00100000:0.0:1789185632.909292:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812391168 00000100:00100000:3.0:1789185632.909319:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:3.0:1789185632.909333:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812391296:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185632.909477:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812391296:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 148us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185632.910507:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812391040 00000100:00100000:2.0:1789185632.910517:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812391040 00000100:00100000:2.0:1789185632.910574:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 296 00000100:00100000:2.0:1789185632.910584:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812391040:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185632.910649:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812391040:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 66us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185632.910656:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 296 00000100:00100000:0.0:1789185632.916227:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:0.0:1789185632.916253:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2370:x1876096812391168:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185632.916354:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2370:x1876096812391168:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 113us (7500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185632.916362:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:3.0:1789185632.918651:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:1.0:1789185633.046587:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185633.046958:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812391552 00000100:00100000:2.0:1789185633.046977:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812391552 00000100:00100000:2.0:1789185633.047083:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 157 00000100:00100000:2.0:1789185633.047103:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+24:11479:x1876096812391552:12345-192.168.202.54@tcp:101:stat.0 00010000:00010000:2.0:1789185633.047132:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185633.047166:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c45d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d712 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.047234:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c464 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.047249:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c464 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.047262:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c464 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.047277:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c46b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.047284:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c46b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.047290:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c46b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.048796:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c472 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.048817:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c472 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.048827:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c472 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185633.048875:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789185633.048880:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789185633.048901:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c472 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.048921:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c472 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.048930:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c464 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.048936:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c464 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.048943:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c464 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.048948:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fea00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185633.048952:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c464 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.048959:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c464 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.048985:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:2.0:1789185633.048988:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185633.048993:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c464 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.049000:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c464 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.049012:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c46b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.049018:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c46b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.049030:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c46b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.049035:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fe200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185633.049038:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c46b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.049045:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c46b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.049052:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c792334a600) 00010000:00010000:2.0:1789185633.049054:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185633.049057:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c46b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.049063:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c46b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.049115:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c45d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d712 expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.054922:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c472 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d712 expref: 25 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.054935:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:2.0:1789185633.054938:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185633.054942:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073fe800, rc 0) 00000100:00100000:2.0:1789185633.055031:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+25:11479:x1876096812391552:12345-192.168.202.54@tcp:101:stat.0 Request processed in 7936us (8453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185633.055059:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 157 00000100:00080000:0.0:1789185633.060739:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185633.226393:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185633.226695:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812391808 00000100:00100000:1.0:1789185633.226712:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812391808 00000100:00100000:1.0:1789185633.226796:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 158 00000100:00100000:1.0:1789185633.226811:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+25:11489:x1876096812391808:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789185633.226842:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185633.226875:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d719 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185633.227029:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789185633.227443:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c479 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d719 expref: 27 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.227472:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334a200) 00010000:00010000:1.0:1789185633.227476:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789185633.227482:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d719 expref: 27 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.227500:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4dc00, rc 0) 00000100:00100000:1.0:1789185633.228097:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:11489:x1876096812391808:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1277us (1708us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1789185633.228115:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 158 00000100:00100000:1.0:1789185633.232671:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185633.232829:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812392064 00000100:00100000:0.0:1789185633.232845:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812392064 00000100:00100000:0.0:1789185633.232957:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:0.0:1789185633.232971:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791916d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:11489:x1876096812392064:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:0.0:1789185633.233532:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791916d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+27:11489:x1876096812392064:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 561us (1123us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1789185633.233541:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:2.0:1789185633.317551:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185633.317906:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812392320 00000100:00100000:1.0:1789185633.317921:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812392320 00000100:00100000:1.0:1789185633.318005:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 159 00000100:00100000:1.0:1789185633.318020:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+27:11495:x1876096812392320:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789185633.318056:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185633.318085:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c487 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d720 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.318381:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.318401:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c472 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d712 expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.318478:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.318531:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c472 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d712 expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.318549:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c472 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d712 expref: 28 pid: 5824 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185633.318865:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821830144:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789185633.319091:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7929b2dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185633.323961:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821830144:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789185633.324011:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185633.325873:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185633.326001:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812392448 00000100:00100000:1.0:1789185633.326015:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812392448 00010000:00010000:1.0:1789185633.326073:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c472 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d712 expref: 29 pid: 5824 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185633.326144:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:1.0:1789185633.326157:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+29:2371:x1876096812392448:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185633.326353:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185633.326363:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c472 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d712 expref: 29 pid: 5824 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.326441:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c472 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d712 expref: 29 pid: 5824 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.326482:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c472 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d712 expref: 29 pid: 5824 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.326505:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:1.0:1789185633.326512:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.326523:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.326532:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.327629:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185633.327743:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+28:2371:x1876096812392448:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 1581us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185633.327758:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 65 00010000:00010000:3.0:1789185633.329919:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.329945:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185633.329978:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789185633.330517:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c487 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d720 expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.330547:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d720 expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.330723:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:3.0:1789185633.330727:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789185633.330732:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4c000, rc 0) 00000100:00100000:3.0:1789185633.330905:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+28:11495:x1876096812392320:12345-192.168.202.54@tcp:101:bash.0 Request processed in 12887us (13367us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1789185633.330916:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 159 00000100:00100000:2.0:1789185633.336918:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185633.337049:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812392704 00000100:00100000:0.0:1789185633.337065:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812392704 00000100:00100000:0.0:1789185633.337164:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 160 00000100:00100000:0.0:1789185633.337178:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+28:11495:x1876096812392704:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:0.0:1789185633.337644:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c49c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185633.337670:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c49c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185633.337686:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c49c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789185633.337758:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1789185633.337784:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002e4e7f6d reply state 0000000081179ec8 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c49c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185633.337794:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789185633.337919:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+31:11495:x1876096812392704:12345-192.168.202.54@tcp:36:bash.0 Request processed in 742us (1018us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1789185633.337926:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 160 00000020:00080000:0.0:1789185633.337933:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789185633.343434:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c49c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.343470:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c49c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.343480:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c49c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.343487:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185633.343492:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c49c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.343502:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c49c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.343525:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:3.0:1789185633.343529:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185633.343559:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c49c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.343566:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c49c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185633.346488:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185633.346806:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812392832 00000100:00100000:0.0:1789185633.346823:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812392832 00000100:00100000:0.0:1789185633.346907:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00100000:0.0:1789185633.346920:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+30:11495:x1876096812392832:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1789185633.346955:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185633.346986:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c4a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d727 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185633.347115:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c4aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185633.347135:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d720 expref: 31 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185633.347165:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c4aa lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185633.347219:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d720 expref: 31 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185633.347238:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d720 expref: 31 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185633.347270:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7907d00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876096821830272:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789185633.347392:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185633.352162:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185633.352273:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812392960 00000100:00100000:3.0:1789185633.352286:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812392960 00010000:00010000:3.0:1789185633.352343:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d720 expref: 32 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185633.352396:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:3.0:1789185633.352468:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:2372:x1876096812392960:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185633.352488:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185633.352554:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d720 expref: 32 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.352583:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d720 expref: 32 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.352619:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:3.0:1789185633.352625:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c4aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.352638:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c4aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.352648:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c4aa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.352675:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185633.352771:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:2372:x1876096812392960:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 306us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185633.352780:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 66 00010000:00010000:0.0:1789185633.354465:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c48e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d720 expref: 31 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185633.354497:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7907d00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876096821830272:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185633.354534:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c4aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185633.354546:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c4aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185633.354553:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c4aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185633.354685:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789185633.354691:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185633.354717:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c4aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185633.354786:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c4a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d727 expref: 31 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185633.354804:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c4aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d727 expref: 30 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185633.354814:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:0.0:1789185633.354817:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185633.354821:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355000, rc 0) 00000100:00100000:0.0:1789185633.354964:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+30:11495:x1876096812392832:12345-192.168.202.54@tcp:101:bash.0 Request processed in 8045us (8489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185633.354973:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00100000:2.0:1789185633.361024:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185633.366872:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812393216 00000100:00100000:3.0:1789185633.366896:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812393216 00000100:00100000:2.0:1789185633.369631:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:2.0:1789185633.369653:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+30:11495:x1876096812393216:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:2.0:1789185633.370045:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+31:11495:x1876096812393216:12345-192.168.202.54@tcp:35:bash.0 Request processed in 397us (9034us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789185633.370054:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00010000:00010000:1.0:1789185633.423689:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185633.480266:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185633.480369:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812393472 00000100:00100000:2.0:1789185633.480380:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812393472 00000100:00100000:2.0:1789185633.480492:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 162 00000100:00100000:2.0:1789185633.480505:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+31:11505:x1876096812393472:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185633.480530:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185633.480555:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fec00/0x532743011272c4b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d72e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185633.480673:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789185633.480810:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fec00/0x532743011272c4b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d72e expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.480837:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334a200) 00010000:00010000:2.0:1789185633.480840:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185633.480847:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fec00/0x532743011272c4b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d72e expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.480861:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073fec00, rc 0) 00000100:00100000:2.0:1789185633.480917:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:11505:x1876096812393472:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 417us (663us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1789185633.480925:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 162 00000100:00100000:3.0:1789185633.485185:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185633.485654:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812393600 00000100:00100000:1.0:1789185633.485666:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812393600 00000100:00100000:1.0:1789185633.485719:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 163 00000100:00100000:1.0:1789185633.485729:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:11505:x1876096812393600:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:1.0:1789185633.485809:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.485846:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.485859:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.485876:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.485883:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.485891:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486203:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c4cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486213:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c4cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486220:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c4cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185633.486265:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c4cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486279:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486287:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486305:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486312:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185633.486317:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486324:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486336:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:1.0:1789185633.486340:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185633.486344:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486351:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486363:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486369:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486375:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486380:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4ce00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185633.486383:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486401:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486464:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c791aedc700) 00010000:00010000:1.0:1789185633.486467:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185633.486470:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486476:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486492:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c4cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486498:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c4cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486505:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c4cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486510:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185633.486514:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c4cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486520:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c4cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486527:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:1.0:1789185633.486529:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185633.486532:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c4cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.486548:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c4cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185633.486629:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:11505:x1876096812393600:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 899us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185633.486638:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 163 00000100:00100000:0.0:1789185633.489735:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185633.490548:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812393856 00000100:00100000:3.0:1789185633.490560:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812393856 00000100:00100000:3.0:1789185633.490623:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:3.0:1789185633.490634:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:11505:x1876096812393856:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789185633.490885:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+33:11505:x1876096812393856:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 252us (1161us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789185633.490894:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:2.0:1789185633.566003:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185633.568496:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812394112 00000100:00100000:1.0:1789185633.568515:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812394112 00000100:00100000:1.0:1789185633.568600:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 164 00000100:00100000:1.0:1789185633.568612:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+33:11508:x1876096812394112:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789185633.568661:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185633.568687:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c4d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d735 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.569109:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.569126:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.569137:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.569153:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.569160:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.569188:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.573978:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c4e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.574002:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.574014:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185633.574026:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789185633.574129:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.574138:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.574144:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.574150:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4ce00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185633.574154:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.574163:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.574176:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:1.0:1789185633.574179:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185633.575574:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.575583:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c4db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.575601:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.575608:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.575614:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.575619:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185633.575623:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.575681:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.575694:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c791aedc700) 00010000:00010000:1.0:1789185633.575697:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185633.575700:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.575705:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c4e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.575903:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c4d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d735 expref: 36 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.575935:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d735 expref: 35 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.575942:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:1.0:1789185633.575944:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185633.575946:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4c200, rc 0) 00000100:00100000:1.0:1789185633.576085:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:11508:x1876096812394112:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 7474us (10091us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789185633.576096:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 164 00000100:00100000:0.0:1789185633.582824:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185633.582984:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812394240 00000100:00100000:1.0:1789185633.582994:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812394240 00000100:00100000:1.0:1789185633.583056:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 165 00000100:00100000:1.0:1789185633.583066:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:11508:x1876096812394240:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:1.0:1789185633.583141:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c4f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.583159:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.583171:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.583208:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.583216:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c4f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.583237:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.583244:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185633.583248:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.583257:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c4f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.583270:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:1.0:1789185633.583274:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789185633.583279:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c4f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185633.583286:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c4f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185633.583343:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185633.583356:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:11508:x1876096812394240:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 292us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185633.583364:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 165 00000100:00100000:3.0:1789185633.583368:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812394368 00000100:00100000:3.0:1789185633.583372:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812394368 00000100:00100000:3.0:1789185633.583427:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:3.0:1789185633.583436:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:2369:x1876096812394368:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185633.583457:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185633.583473:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c4e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d735 expref: 35 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.583486:0:6692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:3.0:1789185633.583489:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185633.583510:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+34:2369:x1876096812394368:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 76us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185633.583518:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:0.0:1789185633.587385:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185633.587575:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812394624 00000100:00100000:3.0:1789185633.587585:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812394624 00000100:00100000:3.0:1789185633.587664:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:3.0:1789185633.587673:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+34:11508:x1876096812394624:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789185633.587914:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:11508:x1876096812394624:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 242us (539us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789185633.587922:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:3.0:1789185633.755172:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185633.755286:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812394880 00000100:00100000:2.0:1789185633.755301:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812394880 00000100:00100000:2.0:1789185633.755380:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 166 00000100:00100000:2.0:1789185633.755391:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:11526:x1876096812394880:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:2.0:1789185633.755479:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185633.755502:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fec00/0x532743011272c4fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d73c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.755618:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c505 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.755633:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c505 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.755645:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c505 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185633.755673:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789185633.755800:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fec00/0x532743011272c4fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d73c expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.755819:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c505 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d73c expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.755827:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:2.0:1789185633.755830:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789185633.755834:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073fe600, rc 0) 00000100:00100000:2.0:1789185633.755900:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+37:11526:x1876096812394880:12345-192.168.202.54@tcp:101:cat.0 Request processed in 511us (744us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1789185633.755908:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 166 00000100:00100000:1.0:1789185633.786614:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185633.786795:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812395008 00000100:00100000:3.0:1789185633.786807:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812395008 00000100:00100000:3.0:1789185633.786877:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 167 00000100:00100000:3.0:1789185633.786887:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+37:11527:x1876096812395008:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185633.786911:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185633.786932:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c513 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d743 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.786998:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c51a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.787012:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c51a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.787024:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c51a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185633.787059:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789185633.787063:0:5822:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789185633.787096:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c51a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.787150:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c513 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d743 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.787171:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c51a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d743 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.787180:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:3.0:1789185633.787183:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789185633.787187:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04200, rc 0) 00000100:00100000:3.0:1789185633.787254:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:11527:x1876096812395008:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 368us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185633.787261:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 167 00000100:00100000:0.0:1789185633.797026:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185633.797269:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812395392 00000100:00100000:3.0:1789185633.797279:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812395392 00000100:00100000:3.0:1789185633.797343:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:3.0:1789185633.797353:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:11527:x1876096812395392:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789185633.798784:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+39:11527:x1876096812395392:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 1425us (1760us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789185633.798795:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:2.0:1789185633.804401:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185633.805137:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812395520 00000100:00100000:3.0:1789185633.805148:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812395520 00000100:00100000:3.0:1789185633.805221:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:3.0:1789185633.805233:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+39:11527:x1876096812395520:12345-192.168.202.54@tcp:103:lfs.0 00010000:00010000:3.0:1789185633.805250:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789185633.805274:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c4aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d727 expref: 39 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.805316:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c505 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d73c expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.805330:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe400/0x532743011272c3ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6e8 expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.805340:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a000) 00010000:00010000:3.0:1789185633.805352:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185633.805530:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:11527:x1876096812395520:12345-192.168.202.54@tcp:103:lfs.0 Request processed in 299us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185633.805538:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:1.0:1789185633.818670:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185633.818851:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812395648 00000100:00100000:2.0:1789185633.818863:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812395648 00000100:00100000:2.0:1789185633.818934:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 168 00000100:00100000:2.0:1789185633.818945:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:11527:x1876096812395648:12345-192.168.202.54@tcp:58:lfs.0 00010000:00010000:2.0:1789185633.819050:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c521 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.819066:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c521 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185633.819078:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c521 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789185633.820209:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789185633.820319:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:11527:x1876096812395648:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 1371us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185633.820329:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 168 00000100:00100000:0.0:1789185633.857991:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185633.858341:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812395776 00000100:00100000:3.0:1789185633.858359:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812395776 00000100:00100000:3.0:1789185633.858486:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 169 00000100:00100000:3.0:1789185633.858501:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:11529:x1876096812395776:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185633.858529:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185633.858573:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c528 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d74a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.858661:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c52f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.858704:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c52f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.858718:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c52f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.858737:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c536 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.858743:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.858748:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859330:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c53d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859342:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859352:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185633.859402:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789185633.859466:0:5822:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789185633.859493:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859506:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859528:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c52f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859535:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c52f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859542:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c52f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859548:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185633.859553:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c52f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859561:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c52f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859576:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:3.0:1789185633.859579:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185633.859585:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c52f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859592:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c52f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859607:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859614:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c536 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859620:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c536 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859633:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185633.859637:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c536 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859644:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c536 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859652:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c79055dd700) 00010000:00010000:3.0:1789185633.859654:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185633.859657:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c536 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859663:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c536 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859705:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c528 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d74a expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859722:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c53d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d74a expref: 37 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185633.859729:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a600) 00010000:00010000:3.0:1789185633.859731:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789185633.860307:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04400, rc 0) 00000100:00100000:2.0:1789185633.862593:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+37:11529:x1876096812395776:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 4086us (4602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185633.862618:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 169 00000100:00100000:2.0:1789185634.191648:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821830400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185634.191747:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185634.191858:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821830400 00000100:00100000:2.0:1789185634.191867:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821830400 00000100:00100000:2.0:1789185634.191938:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789185634.191951:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821830400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789185634.192008:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185634.192063:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821830400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185634.192070:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789185634.192095:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185634.192136:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821830400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185634.194495:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821830528:0@lo:400:kworker.0 00000100:00100000:3.0:1789185634.194589:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185634.194804:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c790833aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821830912:0@lo:400:kworker.0 00000100:00100000:2.0:1789185634.194857:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185634.194898:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821830656:0@lo:400:kworker.0 00000100:00100000:2.0:1789185634.194928:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185634.194947:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789185634.194953:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821830784:0@lo:400:kworker.0 00000100:00100000:2.0:1789185634.194974:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185634.195154:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821830528 00000100:00100000:1.0:1789185634.195165:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821830528 00000100:00100000:1.0:1789185634.195262:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789185634.195274:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821830528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185634.198505:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185634.198543:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7908339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821831040:0@lo:400:kworker.0 00000100:00100000:2.0:1789185634.198640:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185634.198709:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821830656 00000100:00100000:2.0:1789185634.198719:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821830656 00000100:00100000:2.0:1789185634.198784:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789185634.198795:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821830656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185634.198880:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821830656:12345-0@lo:400:kworker.0 Request processed in 87us (3950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185634.198889:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789185634.198911:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821830784 00000100:00100000:2.0:1789185634.198914:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821830784 00000100:00100000:2.0:1789185634.198939:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821831040 00000100:00100000:2.0:1789185634.198941:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821831040 00000100:00100000:2.0:1789185634.198959:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789185634.198965:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821830784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185634.199008:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821830784:12345-0@lo:400:kworker.0 Request processed in 43us (4033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185634.199015:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789185634.199027:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789185634.199034:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821831040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185634.199065:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821831040:12345-0@lo:400:kworker.0 Request processed in 32us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185634.199071:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789185634.199122:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821830784:0@lo:400:kworker.0 00000100:00100000:2.0:1789185634.199136:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821830656:0@lo:400:kworker.0 00000100:00080000:2.0:1789185634.199165:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185634.199181:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7908339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821831040:0@lo:400:kworker.0 00000100:00100000:1.0:1789185634.202057:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821830528:12345-0@lo:400:kworker.0 Request processed in 6713us (7395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185634.202089:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789185634.202393:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821830912 00000100:00100000:1.0:1789185634.202423:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821830912 00000100:00100000:1.0:1789185634.202510:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789185634.202520:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3280:x1876096821830912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185634.202609:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3280:x1876096821830912:12345-0@lo:400:kworker.0 Request processed in 90us (7752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185634.202615:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789185634.202644:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185634.202699:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c790833aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821830912:0@lo:400:kworker.0 00000100:00100000:3.0:1789185634.202951:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821830528:0@lo:400:kworker.0 00000040:00080000:2.0:1789185634.257393:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789185634.257458:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789185634.257894:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789185634.257908:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789185634.258089:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c11c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1876096821831168:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789185634.258215:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c792f6a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185634.271423:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c11c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1876096821831168:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789185634.275730:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185634.287729:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812395904 00000100:00100000:0.0:1789185634.287754:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812395904 00000100:00100000:0.0:1789185634.288135:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 170 00000100:00100000:0.0:1789185634.288150:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+37:11540:x1876096812395904:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789185634.288200:0:5824:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789185634.290359:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+37:11540:x1876096812395904:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 2196us (14628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185634.290384:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 170 00000100:00100000:0.0:1789185634.306590:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185634.306754:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812396032 00000100:00100000:1.0:1789185634.306767:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812396032 00000100:00100000:1.0:1789185634.307226:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:1.0:1789185634.307239:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790833b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+37:11540:x1876096812396032:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789185634.307349:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c544 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.307378:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c544 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.307396:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c544 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.316020:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c54b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.316050:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c54b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.316091:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c54b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.316140:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c552 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.316150:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.316158:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185634.316219:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789185634.316225:0:11024:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789185634.316244:0:11024:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.317972:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c544 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.317991:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c544 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318000:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c544 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318007:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185634.318012:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c544 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318021:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c544 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318064:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c792334af00) 00010000:00010000:1.0:1789185634.318067:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185634.318074:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c544 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318081:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c544 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318100:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c54b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318106:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c54b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318111:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c54b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318116:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185634.318119:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c54b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318124:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c54b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318132:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9c791aedc700) 00010000:00010000:1.0:1789185634.318134:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185634.318137:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c54b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318143:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c54b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318174:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318181:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c552 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318187:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c552 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318191:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4ca00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185634.318194:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c552 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318200:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c552 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318207:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a600) 00010000:00010000:1.0:1789185634.318210:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185634.318212:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c552 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.318218:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c552 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185634.321598:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790833b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+37:11540:x1876096812396032:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 Request processed in 14343us (15004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185634.321617:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:3.0:1789185634.325077:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185634.332025:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812396288 00000100:00100000:1.0:1789185634.332048:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812396288 00000100:00100000:1.0:1789185634.332131:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 172 00000100:00100000:1.0:1789185634.332156:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+37:11540:x1876096812396288:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185634.332188:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185634.332216:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c559 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d751 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.333498:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c560 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.333528:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.333543:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185634.333559:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789185634.333703:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.333712:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c560 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.333721:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.333728:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4ce00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185634.333733:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.333742:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c560 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.333756:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a600) 00010000:00010000:1.0:1789185634.334667:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789185634.334677:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c560 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.334687:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c560 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.334920:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c559 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d751 expref: 39 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.334933:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c792334af00) 00010000:00010000:1.0:1789185634.334936:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789185634.334940:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c559 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d751 expref: 39 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.334962:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4c800, rc 0) 00000100:00100000:1.0:1789185634.335058:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:11540:x1876096812396288:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 2906us (9996us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1789185634.335069:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 172 00000100:00100000:0.0:1789185634.347855:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185634.348024:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812396416 00000100:00100000:3.0:1789185634.348038:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812396416 00000100:00100000:3.0:1789185634.348118:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 173 00000100:00100000:3.0:1789185634.348133:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:11540:x1876096812396416:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789185634.348182:0:5823:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789185634.348328:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:11540:x1876096812396416:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 198us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185634.348336:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 173 00000100:00100000:3.0:1789185634.354611:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185634.354796:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812396672 00000100:00100000:2.0:1789185634.354810:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812396672 00000100:00100000:2.0:1789185634.354894:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 174 00000100:00100000:2.0:1789185634.354907:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:11540:x1876096812396672:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185634.354933:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185634.354937:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789185634.354972:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c51a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d743 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.354995:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:2.0:1789185634.355001:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185634.355018:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c56e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d758 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789185634.355918:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789185634.356209:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff800/0x532743011272c575 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.356228:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff800/0x532743011272c575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.356242:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff800/0x532743011272c575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.356311:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c56e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d758 expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.356344:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff800/0x532743011272c575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d758 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.356353:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c792334a500) 00010000:00010000:2.0:1789185634.356357:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185634.356360:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073ff800, rc 0) 00000100:00100000:2.0:1789185634.356583:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+39:11540:x1876096812396672:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1677us (1984us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789185634.356593:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 174 00000100:00100000:3.0:1789185634.362812:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185634.363099:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812396928 00000100:00100000:1.0:1789185634.363113:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812396928 00000100:00100000:1.0:1789185634.363193:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 175 00000100:00100000:1.0:1789185634.363206:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+39:11540:x1876096812396928:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789185634.363298:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185634.363334:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff800/0x532743011272c575 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d758 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.363358:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c792334a500) 00010000:00010000:1.0:1789185634.363388:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185634.363456:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c583 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.363473:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c583 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.363484:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c583 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.363499:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c58a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x27251ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.363506:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c58a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x27251ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.363512:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c58a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x27251ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.363791:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c583 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.363800:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c583 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.363808:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c583 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.363814:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185634.363819:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c583 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.364084:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c583 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.364111:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:1.0:1789185634.364114:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185634.364119:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c583 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.364125:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c583 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.364136:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c58a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x27251ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.364142:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c58a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x27251ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.364148:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c58a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x27251ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.364153:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4ce00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185634.364156:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c58a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x27251ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.364161:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c58a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x27251ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.364167:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x27251ef (ffff9c791aedc700) 00010000:00010000:1.0:1789185634.364170:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185634.364172:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c58a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x27251ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.364177:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c58a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x27251ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185634.364477:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:11540:x1876096812396928:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 1270us (1679us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789185634.364487:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 175 00000100:00100000:3.0:1789185634.375056:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185634.376517:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812397056 00000100:00100000:1.0:1789185634.376538:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812397056 00000100:00100000:1.0:1789185634.376664:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 176 00000100:00100000:1.0:1789185634.376679:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:11540:x1876096812397056:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185634.376711:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185634.376756:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c591 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d75f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.376816:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c598 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.377376:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.377396:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.377589:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c591 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d75f expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.377613:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d75f expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.377623:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c791aedcb00) 00010000:00010000:1.0:1789185634.377635:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789185634.377640:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4d600, rc 0) 00000100:00100000:1.0:1789185634.377733:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+39:11540:x1876096812397056:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1056us (2694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185634.377742:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 176 00000100:00100000:3.0:1789185634.381675:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185634.396889:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812397312 00000100:00100000:0.0:1789185634.396915:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812397312 00000100:00100000:0.0:1789185634.397018:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 177 00000100:00100000:0.0:1789185634.397033:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+39:11540:x1876096812397312:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789185634.397149:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c59f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.397171:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c59f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.397186:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c59f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789185634.397724:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1789185634.397739:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331437333211ns, next at 332437329031ns, rc = 0 00000004:00010000:0.0:1789185634.397982:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009fbbd91a reply state 000000003cf3d7c8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c59f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185634.397995:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789185634.398138:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+41:11540:x1876096812397312:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 1106us (16473us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789185634.398149:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 177 00010000:00010000:2.0:1789185634.407955:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c59f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.407979:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c59f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.407989:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c59f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.407997:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185634.408003:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c59f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.408014:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c59f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.408038:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c791aedcb00) 00010000:00010000:2.0:1789185634.408043:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789185634.408049:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c59f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.408073:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c59f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185634.408209:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185634.408338:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812397440 00000100:00100000:2.0:1789185634.408350:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812397440 00000100:00100000:2.0:1789185634.408450:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 178 00000100:00100000:2.0:1789185634.408463:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+40:11540:x1876096812397440:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185634.408496:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185634.408519:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c5a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d766 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.408595:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c5a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d766 expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.408612:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c5a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d766 expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.408635:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c791aedcb00) 00010000:00010000:2.0:1789185634.408638:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185634.408641:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073ff200, rc 0) 00000100:00100000:2.0:1789185634.408717:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+41:11540:x1876096812397440:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 256us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185634.408725:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 178 00000100:00100000:3.0:1789185634.427171:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185634.427283:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812397568 00000100:00100000:0.0:1789185634.427298:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812397568 00000100:00100000:0.0:1789185634.427394:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:0.0:1789185634.427432:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812397568:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789185634.427960:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2372:x1876096812397568:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 552us (801us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789185634.427988:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00080000:3.0:1789185634.428378:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185634.435246:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185634.435753:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812397824 00000100:00100000:0.0:1789185634.435770:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812397824 00000100:00100000:0.0:1789185634.435848:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:0.0:1789185634.435861:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+41:11540:x1876096812397824:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789185634.436226:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+42:11540:x1876096812397824:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 366us (994us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1789185634.436235:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:0.0:1789185634.443672:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185634.443917:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812398080 00000100:00100000:2.0:1789185634.443930:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812398080 00000100:00100000:2.0:1789185634.443999:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 179 00000100:00100000:2.0:1789185634.444010:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790833aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+42:11540:x1876096812398080:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789185634.444164:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790833aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+42:11540:x1876096812398080:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 155us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185634.444173:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 179 00010000:00010000:3.0:1789185634.448976:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185634.452496:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185634.452595:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812398208 00000100:00100000:2.0:1789185634.452608:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812398208 00000100:00100000:2.0:1789185634.452684:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 180 00000100:00100000:2.0:1789185634.452697:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+42:11540:x1876096812398208:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185634.452724:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185634.452752:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff800/0x532743011272c5ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d76d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.452855:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c5b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.452874:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.452890:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185634.452940:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789185634.452965:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.453000:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff800/0x532743011272c5ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d76d expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.453021:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d76d expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.453052:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c791aedcb00) 00010000:00010000:2.0:1789185634.453056:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789185634.453061:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073ffe00, rc 0) 00000100:00100000:2.0:1789185634.453148:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+43:11540:x1876096812398208:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 453us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185634.453156:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 180 00000100:00100000:0.0:1789185634.459662:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185634.459717:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812398336 00000100:00100000:1.0:1789185634.459734:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812398336 00000100:00100000:1.0:1789185634.459817:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:1.0:1789185634.459841:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2371:x1876096812398336:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185634.459868:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185634.459899:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272c5bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d774 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789185634.459936:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4ce61, blocks: 0x1 00010000:00010000:1.0:1789185634.459962:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=331s v=(0 0) 00010000:00010000:1.0:1789185634.459968:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185634.459981:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272c5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d774 expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.460003:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272c5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d774 expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.460019:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4d000, rc 0) 00000100:00100000:1.0:1789185634.460102:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2371:x1876096812398336:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 273us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185634.460126:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:3.0:1789185634.464965:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185634.465069:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812398592 00000100:00100000:1.0:1789185634.465082:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812398592 00000100:00100000:1.0:1789185634.465158:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 181 00000100:00100000:1.0:1789185634.465170:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+43:11540:x1876096812398592:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789185634.465322:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+43:11540:x1876096812398592:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 154us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185634.465331:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 181 00000100:00100000:2.0:1789185634.473605:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185634.473660:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812398720 00000100:00100000:2.0:1789185634.473673:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812398720 00000100:00100000:2.0:1789185634.473751:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:2.0:1789185634.473765:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:11540:x1876096812398720:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185634.473795:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185634.473824:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c5c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d77b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.473872:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272c5bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d774 expref: 9 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.473885:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185634.473891:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185634.473898:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c5c2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d77b expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.473941:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272c5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d774 expref: 9 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.473984:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272c5bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d774 expref: 9 pid: 6678 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185634.474002:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1876096821831296:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185634.474126:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c792f6a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185634.488475:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185634.488522:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1876096821831296:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789185634.488568:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c5c2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d77b expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.488595:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073ff800, rc 0) 00000100:00100000:2.0:1789185634.488677:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:11540:x1876096812398720:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 14914us (15087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185634.488688:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:1.0:1789185634.488835:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812398848 00000100:00100000:1.0:1789185634.488845:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812398848 00010000:00010000:1.0:1789185634.488886:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272c5bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d774 expref: 9 pid: 6678 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185634.488925:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:1.0:1789185634.488936:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2371:x1876096812398848:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185634.488965:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185634.488995:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272c5bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d774 expref: 9 pid: 6678 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.489014:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272c5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d774 expref: 9 pid: 6678 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.489045:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272c5bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d774 expref: 9 pid: 6678 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.489083:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185634.489088:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185634.489098:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c5c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d77b expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.489109:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c5c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d77b expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.489148:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c5c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d77b expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185634.489163:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5810:1876096821831424:192.168.202.54@tcp:105: 00000100:00100000:1.0:1789185634.489252:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791a5cf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185634.498860:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5810:1876096821831424:192.168.202.54@tcp:105: 00010000:00010000:3.0:1789185634.498901:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185634.500115:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2371:x1876096812398848:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 11172us (11652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185634.500132:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:3.0:1789185634.506916:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185634.507115:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812398976 00000100:00100000:1.0:1789185634.507129:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812398976 00002000:00100000:1.0:1789185634.507194:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9c7936b58a80 x1876096812398976/t0(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:235/0 lens 504/0 e 0 to 0 dl 1789185645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789185634.507207:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7936b58a80 with x1876096812398976 ext(0->8) 00002000:00010000:1.0:1789185634.507213:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7936b58a80 00000100:00100000:1.0:1789185634.507251:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:1.0:1789185634.507260:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2371:x1876096812398976:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789185634.509311:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+10:2371:x1876096812398976:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 Request processed in 2037us (2397us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789185634.509426:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00002000:00100000:1.0:1789185634.509450:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9c7936b58a80 x1876096812398976/t4294967314(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:235/0 lens 504/448 e 0 to 0 dl 1789185645 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789185634.509461:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7936b58a80 with x1876096812398976 ext(0->8) 00002000:00010000:1.0:1789185634.509469:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7936b58a80 00000100:00100000:2.0:1789185634.532624:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185634.532678:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812399104 00000100:00100000:2.0:1789185634.532692:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812399104 00000100:00100000:2.0:1789185634.532771:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 182 00000100:00100000:2.0:1789185634.532785:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+43:11540:x1876096812399104:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789185634.619258:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+43:11540:x1876096812399104:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 Request processed in 86460us (86636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185634.619274:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 182 00000001:00080000:0.0:1789185634.619331:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1789185634.619463:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1789185634.619525:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1789185634.619558:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1789185634.619571:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789185634.622399:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185634.622488:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812399232 00000100:00100000:0.0:1789185634.622502:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812399232 00000100:00100000:0.0:1789185634.622577:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:0.0:1789185634.622592:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+10:2369:x1876096812399232:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789185634.623701:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821831552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789185634.623808:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185634.624209:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821831552 00000100:00100000:3.0:1789185634.624219:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821831552 00000100:00100000:3.0:1789185634.624269:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789185634.624280:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821831552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789185634.624528:0:6884:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789185634.624532:0:6884:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789185633 00002000:00010000:3.0:1789185634.624535:0:6884:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789185634.624537:0:6884:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789185633 -> 1789185633 00002000:00010000:3.0:1789185634.624540:0:6884:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789185634.624602:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3278:x1876096821831552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 324us (794us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789185634.624611:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:2.0:1789185634.625367:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c793fccdc00/2, rc 0, transno 4294967315 00000100:00100000:2.0:1789185634.625380:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821831552:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1789185634.698649:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1789185634.698683:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:2.0:1789185634.698695:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1789185634.699820:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2369:x1876096812399232:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 Request processed in 77219us (77423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185634.699849:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:0.0:1789185634.708662:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185634.708710:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812399488 00000100:00100000:0.0:1789185634.708724:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812399488 00000100:00100000:0.0:1789185634.708804:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 183 00000100:00100000:0.0:1789185634.708817:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+18:11540:x1876096812399488:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789185634.710363:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185634.710428:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c5b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d76d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.710459:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c791aedcb00) 00010000:00010000:0.0:1789185634.710466:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185634.710511:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.710528:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.710540:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789185634.710961:0:5822:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000027e703ff reply state 0000000050051fb4 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185634.710974:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789185634.711132:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:11540:x1876096812399488:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 2315us (2481us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1789185634.711142:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 183 00010000:00010000:0.0:1789185634.716087:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.716112:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.716122:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.716130:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185634.716136:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.716145:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.716168:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c791aedcb00) 00010000:00010000:0.0:1789185634.716171:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185634.716177:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.716184:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185634.719151:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185634.720037:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812399616 00000100:00100000:3.0:1789185634.720054:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812399616 00000100:00100000:3.0:1789185634.720151:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:3.0:1789185634.720164:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2372:x1876096812399616:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789185634.720542:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789185634.720547:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789185633 -> 1789185632 00002000:00010000:3.0:1789185634.720550:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789185631 00002000:00010000:3.0:1789185634.720552:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789185633 -> 1789185632 00002000:00010000:3.0:1789185634.720555:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789185634.720642:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2372:x1876096812399616:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 481us (1507us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789185634.720650:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:3.0:1789185634.729811:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185634.740047:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812399872 00000100:00100000:0.0:1789185634.740070:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812399872 00000100:00100000:0.0:1789185634.740156:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 184 00000100:00100000:0.0:1789185634.740168:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+18:11540:x1876096812399872:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789185634.740263:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.740285:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c598 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d75f expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.740309:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5d0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.740360:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d75f expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.740379:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c598 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d75f expref: 18 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185634.740397:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876096821831680:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789185634.746246:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185634.749974:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185634.750017:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812400000 00000100:00100000:2.0:1789185634.750031:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812400000 00010000:00010000:2.0:1789185634.750084:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c598 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d75f expref: 19 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185634.750130:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:2.0:1789185634.750144:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793081d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:2372:x1876096812400000:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185634.750166:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185634.750174:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c598 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d75f expref: 19 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.750191:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c598 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d75f expref: 19 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.750223:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c791aedcb00) 00010000:00010000:2.0:1789185634.750229:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.750242:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.750251:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5d0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.750277:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185634.750340:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793081d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:2372:x1876096812400000:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 199us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185634.750359:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 68 00010000:00010000:0.0:1789185634.752157:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c598 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d75f expref: 18 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185634.752190:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876096821831680:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185634.752226:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.752237:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.752244:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.752285:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.752294:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.752314:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.752321:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185634.752326:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.752336:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.752351:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c791aedcb00) 00010000:00010000:0.0:1789185634.752355:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789185634.752361:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.752367:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185634.752487:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+17:11540:x1876096812399872:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 Request processed in 12320us (22691us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789185634.752499:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 184 00000100:00100000:3.0:1789185634.763753:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185634.763829:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812400128 00000100:00100000:3.0:1789185634.763841:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812400128 00000100:00100000:3.0:1789185634.763909:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:3.0:1789185634.763922:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2371:x1876096812400128:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789185634.763987:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ecb1a96d/0x532743011272c5d7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.764015:0:6884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c5c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d77b expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.764026:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185634.764031:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185634.764037:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecb1a96d/0x532743011272c5d7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.764104:0:6884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c5c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d77b expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.764124:0:6884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c5c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d77b expref: 8 pid: 6679 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185634.764143:0:6884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6884:1876096821831808:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185634.764245:0:6884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78039a6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185634.773275:0:6884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6884:1876096821831808:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185634.773326:0:6884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ecb1a96d/0x532743011272c5d7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185634.773348:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185634.773461:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812400256 00000100:00100000:1.0:1789185634.773472:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812400256 00010000:00010000:1.0:1789185634.773519:0:6692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c5c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d77b expref: 9 pid: 6679 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185634.773575:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:1.0:1789185634.773586:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2372:x1876096812400256:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185634.773605:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185634.773637:0:6692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c5c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d77b expref: 9 pid: 6679 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.773655:0:6692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c5c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d77b expref: 9 pid: 6679 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.773685:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c5c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d77b expref: 9 pid: 6679 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.773706:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185634.773713:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185634.773731:0:6692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecb1a96d/0x532743011272c5d7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.773742:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecb1a96d/0x532743011272c5d7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.773769:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185634.773797:0:6884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ecb1a96d/0x532743011272c5d7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.773808:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecb1a96d/0x532743011272c5d7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185634.773844:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2372:x1876096812400256:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 257us (496us total) trans 0 rc 0/0 00010000:00010000:3.0:1789185634.773845:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ecb1a96d/0x532743011272c5d7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185634.773860:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00010000:00010000:3.0:1789185634.773863:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecb1a96d/0x532743011272c5d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.773875:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecb1a96d/0x532743011272c5d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.773884:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05200 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185634.773889:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecb1a96d/0x532743011272c5d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.773900:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecb1a96d/0x532743011272c5d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.773913:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecb1a96d/0x532743011272c5d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.773934:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecb1a96d/0x532743011272c5d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185634.773992:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2371:x1876096812400128:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 Request processed in 10072us (10255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185634.774002:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:2.0:1789185634.777058:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185634.777113:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812400512 00000100:00100000:3.0:1789185634.777127:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812400512 00000100:00100000:3.0:1789185634.777194:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 185 00000100:00100000:3.0:1789185634.777207:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+17:11540:x1876096812400512:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789185634.777828:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c5de lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.777856:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c5de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.777874:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c5de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.778174:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c5e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.778190:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c5a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d766 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.778199:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c5e5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.778265:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c5a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d766 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.778289:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c5a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d766 expref: 18 pid: 5824 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185634.778307:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821831936:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185634.778784:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78039a6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185634.780758:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821831936:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185634.780795:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c5e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185634.781569:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185634.781665:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812400640 00000100:00100000:3.0:1789185634.781677:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812400640 00010000:00010000:3.0:1789185634.781727:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c5a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d766 expref: 19 pid: 5824 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185634.781774:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:3.0:1789185634.781786:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:2371:x1876096812400640:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185634.781805:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185634.781814:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c5a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d766 expref: 19 pid: 5824 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.781841:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c5a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d766 expref: 19 pid: 5824 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.781869:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c5a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d766 expref: 19 pid: 5824 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.781906:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c791aedcb00) 00010000:00010000:3.0:1789185634.781913:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c5e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.781970:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c5e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.781980:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c5e5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.782011:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185634.782076:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+18:2371:x1876096812400640:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 292us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185634.782084:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 70 00010000:00010000:3.0:1789185634.782192:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c5e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185634.782201:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c5e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789185634.782526:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1789185634.782714:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1789185634.782766:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1789185634.782873:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876096821832064:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789185634.782947:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185634.782994:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78039a6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185634.783259:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821832064 00000100:00100000:1.0:1789185634.783270:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821832064 00000100:00100000:1.0:1789185634.783336:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789185634.783348:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1876096821832064:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789185634.783500:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1876096821832064:12345-0@lo:1000:mdt00_000.0 Request processed in 154us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185634.783508:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789185634.783576:0:5822:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1789185634.783584:0:5822:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c793fccdc00, transno 4294967315 00000100:00100000:2.0:1789185634.783608:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876096821832064:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789185634.784137:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1789185634.784210:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876096821832192:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789185634.784255:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185634.784285:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c792f6a1e40 going to sleep for 11 seconds 00000001:00080000:2.0:1789185634.784544:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1789185634.784565:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1789185634.784703:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821832192 00000100:00100000:1.0:1789185634.784711:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821832192 00000100:00100000:1.0:1789185634.784745:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789185634.784753:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1876096821832192:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789185634.785001:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5822:x1876096821832192:12345-0@lo:1000:mdt00_000.0 Request processed in 248us (745us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789185634.785009:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789185634.787851:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876096821832192:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789185634.787941:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c5e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.787955:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c5e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.787965:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c5e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.787973:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185634.787979:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c5e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.787989:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c5e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.788037:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c791aedcb00) 00010000:00010000:2.0:1789185634.788041:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185634.788049:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c5e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.788056:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c5e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.788115:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c521 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.788121:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c521 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.788127:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c521 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.788132:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073ffc00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185634.788134:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c521 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.788141:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c521 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.788149:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a600) 00010000:00010000:2.0:1789185634.788151:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185634.788154:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c521 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.788160:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c521 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.788197:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c5ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.788214:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c53d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d74a expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.788224:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c5ec lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.788283:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c53d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d74a expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.788303:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c53d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d74a expref: 21 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185634.788321:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821832320:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185634.788567:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c792f6a1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185634.801473:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821832320:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789185634.801524:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c5ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185634.808392:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185634.809340:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812400768 00000100:00100000:1.0:1789185634.809358:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812400768 00010000:00010000:1.0:1789185634.809452:0:6692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c53d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d74a expref: 22 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185634.809529:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:1.0:1789185634.809542:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+22:2371:x1876096812400768:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185634.809562:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185634.809570:0:6692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c53d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d74a expref: 22 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.809588:0:6692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c53d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d74a expref: 22 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.809616:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c53d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d74a expref: 22 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.809633:0:6692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a600) 00010000:00010000:1.0:1789185634.809639:0:6692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c5ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.809651:0:6692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c5ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.809660:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c5ec lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.809704:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185634.809756:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c5ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.809766:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c5ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.809794:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c5ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.809802:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c5ec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.809809:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c5ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.809817:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fe800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185634.809823:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c5ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.809832:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c5ec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.809842:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a600) 00010000:00010000:2.0:1789185634.809845:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185634.809850:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c5ec lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.809857:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c5ec lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.809869:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c5de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.809874:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c5de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.809879:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c5de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.809891:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185634.809894:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c5de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.809901:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c5de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.809910:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c792334a600) 00010000:00010000:2.0:1789185634.809913:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789185634.809916:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c5de lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.809922:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c5de lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789185634.810400:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185634.810423:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1789185634.810944:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:2371:x1876096812400768:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 1398us (2562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185634.810957:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 71 00000040:00080000:3.0:1789185634.811680:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1789185634.811705:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789185634.813322:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:11540:x1876096812400512:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 36102us (36264us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789185634.813343:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 185 00000020:00080000:2.0:1789185634.813353:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789185634.827752:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185634.828228:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812401024 00000100:00100000:0.0:1789185634.828241:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812401024 00000100:00100000:0.0:1789185634.828318:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:0.0:1789185634.828332:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791916c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:11540:x1876096812401024:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789185634.829385:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789185634.829565:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1789185634.829644:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.829667:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.829684:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.829694:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5f3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.829702:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5f3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.829710:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185634.829746:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789185634.829858:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185634.829868:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.829878:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355e00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185634.829883:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.829893:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.829917:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c79117a4200) 00010000:00010000:2.0:1789185634.829920:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789185634.829927:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5f3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185634.829934:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c5f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185634.830030:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185634.830040:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185634.830041:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185634.832945:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791916c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+22:11540:x1876096812401024:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 4599us (5190us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789185634.832965:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 50 00000020:00080000:1.0:1789185634.832974:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1789185634.991160:0:12509:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789185634.991176:0:12509:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789185634.991225:0:12509:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789185634.991232:0:12509:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789185635.141278:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185635.141387:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812401280 00000100:00100000:2.0:1789185635.141400:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812401280 00000100:00100000:2.0:1789185635.141533:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 186 00000100:00100000:2.0:1789185635.141547:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+22:11550:x1876096812401280:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185635.141585:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185635.141615:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c5fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d782 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.141761:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c601 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.141780:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c601 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.141796:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c601 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185635.141809:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789185635.141993:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c5fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d782 expref: 25 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.142031:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c601 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d782 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.142042:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:2.0:1789185635.142046:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789185635.142051:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073fe200, rc 0) 00000100:00100000:2.0:1789185635.142272:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+24:11550:x1876096812401280:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 728us (1008us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789185635.142282:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 186 00000100:00080000:3.0:1789185635.142832:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185635.145606:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185635.145746:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812401408 00000100:00100000:3.0:1789185635.145761:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812401408 00000100:00100000:3.0:1789185635.145849:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 187 00000100:00100000:3.0:1789185635.145863:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+24:11550:x1876096812401408:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:3.0:1789185635.145978:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c60f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.146002:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c60f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.146018:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c60f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.146037:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c616 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.146045:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.146053:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.146702:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c61d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.146715:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.146723:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185635.146795:0:11024:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.146812:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c60f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147131:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c60f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147140:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c60f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147148:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185635.147154:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c60f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147163:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c60f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147178:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:3.0:1789185635.147182:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185635.147188:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c60f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147196:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c60f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147210:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147217:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c616 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147231:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147237:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185635.147239:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147246:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c616 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147253:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c79055ddf00) 00010000:00010000:3.0:1789185635.147256:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185635.147258:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c616 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147263:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c616 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147281:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147288:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c61d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147294:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c61d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147299:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185635.147302:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c61d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147319:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c61d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147540:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:3.0:1789185635.147544:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185635.147548:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c61d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.147555:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c61d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185635.147679:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+24:11550:x1876096812401408:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 1815us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185635.147690:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 187 00000100:00100000:2.0:1789185635.200943:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.201042:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812401664 00000100:00100000:0.0:1789185635.201056:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812401664 00000100:00100000:0.0:1789185635.201302:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 188 00000100:00100000:0.0:1789185635.201315:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+24:11553:x1876096812401664:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789185635.201348:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185635.201378:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c624 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d789 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.201535:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c62b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.201586:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c62b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.201602:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c62b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.201623:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c632 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.201630:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.201637:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202217:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202228:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202235:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185635.202247:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789185635.202373:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c62b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202383:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c62b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202391:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c62b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202459:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185635.202466:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c62b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202476:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c62b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202491:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:0.0:1789185635.202494:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185635.202501:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c62b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202507:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c62b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202523:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202528:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c632 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202534:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202539:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185635.202542:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202549:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c632 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202786:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c79117a4900) 00010000:00010000:0.0:1789185635.202788:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185635.202792:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c632 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202798:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c632 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202933:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c624 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d789 expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202952:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d789 expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.202961:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c79117a4d00) 00010000:00010000:0.0:1789185635.202964:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185635.202967:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354e00, rc 0) 00000100:00100000:0.0:1789185635.203085:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:11553:x1876096812401664:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1771us (2157us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1789185635.204698:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 188 00000100:00100000:3.0:1789185635.209332:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185635.215020:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812401792 00000100:00100000:2.0:1789185635.215044:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812401792 00000100:00100000:2.0:1789185635.215278:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 189 00000100:00100000:2.0:1789185635.215292:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:11553:x1876096812401792:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:2.0:1789185635.215387:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c647 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.215438:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.215454:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.215487:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.215494:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c647 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.215514:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c647 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.215521:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073ffc00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185635.215527:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c647 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.215537:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c647 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.215552:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c79117a4d00) 00010000:00010000:2.0:1789185635.215555:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185635.215672:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c647 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.215681:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c647 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185635.215789:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:11553:x1876096812401792:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 500us (6475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185635.215798:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 189 00000100:00100000:3.0:1789185635.223532:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821832448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185635.223657:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185635.223756:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821832448 00000100:00100000:3.0:1789185635.223767:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821832448 00000100:00100000:3.0:1789185635.224466:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789185635.224483:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821832448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185635.224535:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185635.224607:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821832448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185635.224615:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789185635.224719:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185635.224751:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812402048 00000100:00100000:3.0:1789185635.224769:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812402048 00000100:00100000:3.0:1789185635.224804:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:3.0:1789185635.224812:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:11553:x1876096812402048:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789185635.225294:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+27:11553:x1876096812402048:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 480us (574us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789185635.225304:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:1.0:1789185635.225603:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1789185635.225613:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1789185635.225641:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c793f129c00, transno 4294967307 00000100:00100000:1.0:1789185635.225675:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821832448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185635.278621:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185635.278666:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812402304 00000100:00100000:2.0:1789185635.278679:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812402304 00000100:00100000:2.0:1789185635.278756:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 190 00000100:00100000:2.0:1789185635.278768:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+27:11088:x1876096812402304:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789185635.278802:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185635.278843:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c64e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d790 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.279008:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.279026:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c639 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d789 expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.279036:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.279101:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d789 expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.279119:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d789 expref: 28 pid: 5824 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185635.279134:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876096821832576:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185635.279252:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c792f6a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185635.290591:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185635.295886:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876096821832576:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185635.295929:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185635.295958:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812402432 00000100:00100000:3.0:1789185635.295966:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812402432 00010000:00010000:3.0:1789185635.296008:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d789 expref: 29 pid: 5824 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185635.296045:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:3.0:1789185635.296053:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+29:2372:x1876096812402432:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185635.296074:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185635.296081:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d789 expref: 29 pid: 5824 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.296095:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d789 expref: 29 pid: 5824 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.296122:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c639 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d789 expref: 29 pid: 5824 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.296160:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c79117a4d00) 00010000:00010000:3.0:1789185635.296164:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.296172:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.296178:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.296203:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185635.296228:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.296236:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185635.296261:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00100000:3.0:1789185635.296277:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+28:2372:x1876096812402432:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 224us (5702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185635.296285:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 72 00010000:00010000:0.0:1789185635.296518:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c64e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d790 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.296546:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d790 expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.296554:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c79117a4d00) 00010000:00010000:0.0:1789185635.296558:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789185635.296560:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073ff200, rc 0) 00000100:00100000:0.0:1789185635.296648:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+28:11088:x1876096812402304:12345-192.168.202.54@tcp:101:bash.0 Request processed in 17882us (18041us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1789185635.296656:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 190 00000100:00100000:2.0:1789185635.299328:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.300226:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812402688 00000100:00100000:0.0:1789185635.300239:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812402688 00000100:00100000:0.0:1789185635.300629:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 191 00000100:00100000:0.0:1789185635.300642:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+28:11088:x1876096812402688:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:0.0:1789185635.300975:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c663 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.300993:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c663 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.301004:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c663 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789185635.301050:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1789185635.301069:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003d91d3de reply state 0000000057f153cb transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c663 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185635.301075:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789185635.301238:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1789185635.301347:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:11088:x1876096812402688:12345-192.168.202.54@tcp:36:bash.0 Request processed in 707us (2033us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789185635.301355:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 191 00000020:00080000:0.0:1789185635.301361:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789185635.306168:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185635.306260:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812402816 00000100:00100000:3.0:1789185635.306273:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812402816 00000100:00100000:3.0:1789185635.306347:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 192 00000100:00100000:3.0:1789185635.306359:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:11088:x1876096812402816:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1789185635.306401:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185635.306458:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c66a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d797 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.306535:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c66a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d797 expref: 33 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.306552:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c66a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d797 expref: 33 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.306594:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c79117a4d00) 00010000:00010000:3.0:1789185635.306598:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789185635.306603:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05000, rc 0) 00000100:00100000:3.0:1789185635.306666:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+33:11088:x1876096812402816:12345-192.168.202.54@tcp:101:bash.0 Request processed in 309us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185635.306674:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 192 00010000:00010000:2.0:1789185635.306901:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c663 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.306911:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c663 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.306919:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c663 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.306926:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185635.306939:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c663 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.306948:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c663 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.306961:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c79117a4d00) 00010000:00010000:2.0:1789185635.306964:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185635.306968:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c663 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.306975:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c663 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185635.315692:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185635.315788:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812402944 00000100:00100000:2.0:1789185635.315801:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812402944 00000100:00100000:2.0:1789185635.315871:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:2.0:1789185635.315880:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:11088:x1876096812402944:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789185635.315902:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185635.315925:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c671 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d79e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789185635.315954:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa4ce60, atime: 0x6aa4ce5f, ctime: 0x6aa4ce60, blocks: 0xb 00010000:00010000:2.0:1789185635.315979:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=332s v=(0 0) 00010000:00010000:2.0:1789185635.315983:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185635.315990:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c671 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d79e expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.316007:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c671 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d79e expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.316036:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073ff800, rc 0) 00000100:00100000:2.0:1789185635.316112:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:11088:x1876096812402944:12345-192.168.202.54@tcp:101:bash.0 Request processed in 231us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185635.316120:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:3.0:1789185635.319547:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185635.319671:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812403072 00000100:00100000:1.0:1789185635.319685:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812403072 00002000:00010000:1.0:1789185635.319739:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1789185635.319746:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7803236a00 with x1876096812403072 ext(0->18446744073709551615) 00002000:00010000:1.0:1789185635.319762:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7803236a00. 00000100:00100000:1.0:1789185635.319790:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:1.0:1789185635.319802:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2369:x1876096812403072:12345-192.168.202.54@tcp:10:bash.0 00002000:00010000:1.0:1789185635.320191:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789185635.320195:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789185632 -> 1789185634 00002000:00010000:1.0:1789185635.320198:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789185631 -> 1789185631 00002000:00010000:1.0:1789185635.320201:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789185632 -> 1789185634 00002000:00010000:1.0:1789185635.320203:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789185635.320332:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2369:x1876096812403072:12345-192.168.202.54@tcp:10:bash.0 Request processed in 530us (796us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789185635.320341:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00002000:00010000:1.0:1789185635.320365:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1789185635.320368:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7803236a00 with x1876096812403072 ext(0->18446744073709551615) 00002000:00010000:1.0:1789185635.320373:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7803236a00. 00000100:00100000:2.0:1789185635.392138:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185635.394878:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812403200 00000100:00100000:3.0:1789185635.394904:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812403200 00000100:00100000:3.0:1789185635.394998:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 193 00000100:00100000:3.0:1789185635.395013:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:11567:x1876096812403200:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:3.0:1789185635.395446:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c678 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.395470:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c678 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.395486:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c678 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.395509:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c67f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.395517:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c67f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.395524:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c67f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.396580:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c686 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.396596:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.396606:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185635.399921:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.399959:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c678 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.399968:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c678 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.399977:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c678 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.399984:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185635.399990:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c678 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400000:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c678 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400022:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:2.0:1789185635.400026:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185635.400032:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c678 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400839:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c678 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400869:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c67f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400878:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c67f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400885:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c67f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400891:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185635.400895:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c67f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400902:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c67f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400915:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c79055ddc00) 00010000:00010000:2.0:1789185635.400919:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185635.400923:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c67f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400929:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c67f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400952:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400958:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c686 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400973:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400978:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185635.400980:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400986:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c686 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.400994:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c79117a4d00) 00010000:00010000:2.0:1789185635.400997:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185635.401000:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c686 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.401006:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c686 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185635.403660:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:11567:x1876096812403200:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 8630us (11518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185635.403680:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 193 00000100:00100000:3.0:1789185635.458681:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185635.458770:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812403456 00000100:00100000:2.0:1789185635.458786:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812403456 00000100:00100000:2.0:1789185635.458881:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 194 00000100:00100000:2.0:1789185635.458895:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+32:11570:x1876096812403456:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185635.458926:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185635.458958:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c68d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d7a5 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.459289:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fee00/0x532743011272c694 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.459309:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fee00/0x532743011272c694 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.459322:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fee00/0x532743011272c694 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.459532:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c69b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.459542:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.459550:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460227:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c6a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460238:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460244:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185635.460255:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789185635.460557:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fee00/0x532743011272c694 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460567:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fee00/0x532743011272c694 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460576:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fee00/0x532743011272c694 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460582:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fee00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185635.460588:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fee00/0x532743011272c694 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460606:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fee00/0x532743011272c694 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460621:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:3.0:1789185635.460624:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185635.460630:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fee00/0x532743011272c694 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460637:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fee00/0x532743011272c694 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460652:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460658:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c69b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460664:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c69b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460668:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073ff600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185635.460670:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c69b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460676:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c69b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460682:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c792334ab00) 00010000:00010000:3.0:1789185635.460685:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185635.460688:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c69b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460704:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff600/0x532743011272c69b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460766:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c68d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7a5 expref: 35 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460784:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c6a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7a5 expref: 34 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.460793:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c79117a4d00) 00010000:00010000:3.0:1789185635.460795:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789185635.460798:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04400, rc 0) 00000100:00100000:3.0:1789185635.460961:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+34:11570:x1876096812403456:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 2068us (2296us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789185635.460972:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 194 00000100:00100000:3.0:1789185635.465692:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.465803:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812403584 00000100:00100000:0.0:1789185635.465818:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812403584 00000100:00100000:0.0:1789185635.466454:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 195 00000100:00100000:0.0:1789185635.466473:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+34:11570:x1876096812403584:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:0.0:1789185635.466572:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c6b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.466594:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d790 expref: 34 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.466606:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c6b0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.466656:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d790 expref: 34 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.466675:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d790 expref: 34 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185635.466692:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876096821832704:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789185635.466861:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905310000 going to sleep for 11 seconds 00000100:00100000:2.0:1789185635.470245:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.470392:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876096821832704:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185635.470470:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c6b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185635.470629:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812403840 00000100:00100000:3.0:1789185635.470639:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812403840 00000100:00100000:3.0:1789185635.470701:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:3.0:1789185635.470711:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:5611:x1876096812403840:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789185635.471120:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:5611:x1876096812403840:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 408us (888us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789185635.471128:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00010000:00010000:1.0:1789185635.471969:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185635.476666:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.478956:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812403968 00000100:00100000:0.0:1789185635.478980:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812403968 00010000:00010000:0.0:1789185635.479258:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d790 expref: 36 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185635.479366:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:0.0:1789185635.479379:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803235f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:2371:x1876096812403968:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185635.479402:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185635.479443:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d790 expref: 36 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.479461:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d790 expref: 36 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.479493:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff200/0x532743011272c655 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d790 expref: 36 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.479516:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c79117a4d00) 00010000:00010000:0.0:1789185635.479522:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c6b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.479534:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.479542:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c6b0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.479638:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185635.479890:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.479901:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.479940:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.479948:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c6b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.479967:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c6b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.479973:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185635.479978:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c6b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.479986:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c6b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.479997:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c79117a4d00) 00010000:00010000:2.0:1789185635.480000:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185635.480004:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c6b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.480010:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272c6b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185635.480173:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803235f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:2371:x1876096812403968:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 795us (3770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185635.480184:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:2.0:1789185635.480953:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+34:11570:x1876096812403584:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 14479us (15266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185635.480966:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 195 00000100:00100000:3.0:1789185635.486021:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.486291:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812404224 00000100:00100000:0.0:1789185635.486306:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812404224 00000100:00100000:0.0:1789185635.486382:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:0.0:1789185635.486395:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+34:11570:x1876096812404224:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:0.0:1789185635.487338:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:11570:x1876096812404224:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 938us (1323us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789185635.487351:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:3.0:1789185635.581826:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.583009:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812404480 00000100:00100000:0.0:1789185635.583027:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812404480 00000100:00100000:1.0:1789185635.583584:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 196 00000100:00100000:1.0:1789185635.583599:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+35:11581:x1876096812404480:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:1.0:1789185635.583638:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185635.583669:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c6b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d7ac expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.583771:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6be lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.583788:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.583802:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.583817:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.583824:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.583831:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584222:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c6cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584658:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c6cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584671:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c6cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185635.584683:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789185635.584813:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584821:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584829:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584835:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185635.584840:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584850:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584864:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:1.0:1789185635.584868:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185635.584874:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584880:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584897:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584910:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584916:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584921:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4dc00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185635.584924:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584931:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584941:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c791aedc100) 00010000:00010000:1.0:1789185635.584943:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185635.584946:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.584952:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.585009:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c6b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7ac expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.585026:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c6cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7ac expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.585033:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c79117a4d00) 00010000:00010000:1.0:1789185635.585036:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185635.585054:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4d400, rc 0) 00000100:00100000:1.0:1789185635.585615:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+37:11581:x1876096812404480:12345-192.168.202.54@tcp:101:cat.0 Request processed in 2015us (3798us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789185635.585626:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 196 00000100:00100000:2.0:1789185635.590694:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.590793:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812404736 00000100:00100000:0.0:1789185635.590807:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812404736 00000100:00100000:0.0:1789185635.590879:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:0.0:1789185635.590892:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+37:11581:x1876096812404736:12345-192.168.202.54@tcp:35:cat.0 00000100:00100000:2.0:1789185635.591997:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:11581:x1876096812404736:12345-192.168.202.54@tcp:35:cat.0 Request processed in 1100us (1309us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789185635.592010:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:2.0:1789185635.613980:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.614185:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812404992 00000100:00100000:0.0:1789185635.614199:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812404992 00000100:00100000:0.0:1789185635.614341:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 197 00000100:00100000:0.0:1789185635.614356:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:11582:x1876096812404992:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1789185635.614951:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789185635.614992:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c6cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7ac expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.615018:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c6a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7a5 expref: 37 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.615030:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c66a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d797 expref: 36 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.615040:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c79117a4d00) 00010000:00010000:1.0:1789185635.615178:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185635.615208:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c6da lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.615225:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c6da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.615237:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c6da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.615324:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.615333:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.615363:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.615947:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.615959:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.615968:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789185635.620865:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1789185635.620890:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332660483475ns, next at 333660476976ns, rc = 0 00010000:00010000:1.0:1789185635.621005:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c6ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621031:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c6ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621186:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c6ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621201:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c6ef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621209:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c6ef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621215:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c6ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621445:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185635.621480:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621487:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621494:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621500:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185635.621506:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621515:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6e8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621530:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c791aedc000) 00010000:00010000:1.0:1789185635.621534:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789185635.621540:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621548:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c000/0x532743011272c6e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621590:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c6da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621598:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c6da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621605:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c6da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621617:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185635.621621:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c6da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621627:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c6da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621635:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:1.0:1789185635.621637:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185635.621641:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c6da lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.621646:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c200/0x532743011272c6da lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185635.621659:0:5822:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a97d829a reply state 0000000066091b44 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185635.621670:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789185635.621801:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+37:11582:x1876096812404992:12345-192.168.202.54@tcp:36:rm.0 Request processed in 7443us (7830us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789185635.621812:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 197 00010000:00010000:3.0:1789185635.627226:0:11163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185635.628001:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.628020:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.628030:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.628060:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4dc00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185635.628067:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.628076:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.628100:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c791aedc100) 00010000:00010000:0.0:1789185635.628103:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185635.628110:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.628118:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c6e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.628217:0:11163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c6ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.628224:0:11163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d800 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185635.628228:0:11163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c6ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.628236:0:11163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c6ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.628312:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c791aedc000) 00010000:00010000:3.0:1789185635.628314:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789185635.628318:0:11163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c6ef lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.628324:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d800/0x532743011272c6ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.628340:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185635.628342:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185635.628344:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185635.686734:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185635.686986:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812405248 00000100:00100000:3.0:1789185635.687001:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812405248 00000100:00100000:3.0:1789185635.687083:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 198 00000100:00100000:3.0:1789185635.687098:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+36:11588:x1876096812405248:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1789185635.687134:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185635.687165:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c6f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d7b3 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.687337:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c6fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.687373:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c6fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.687389:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c6fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.687471:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c704 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.687479:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c704 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.687485:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c704 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789185635.688202:0:11024:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789185635.688470:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c70b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.688484:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c70b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.688493:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c70b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.688539:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c6fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.688547:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c6fd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.688556:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c6fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.688574:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185635.688581:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c6fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.688590:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c6fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.688605:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:3.0:1789185635.688609:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185635.688615:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c6fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.688621:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c6fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185635.688637:0:11024:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000035598873 reply state 0000000057810b03 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c704 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185635.688645:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789185635.688683:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c6f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7b3 expref: 39 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.688711:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c70b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7b3 expref: 38 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.688719:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c79055dd100) 00010000:00010000:3.0:1789185635.688722:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185635.688724:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05000, rc 0) 00000100:00100000:3.0:1789185635.688813:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+39:11588:x1876096812405248:12345-192.168.202.54@tcp:101:bash.0 Request processed in 1719us (2097us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789185635.688828:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 198 00000100:00100000:2.0:1789185635.693305:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:0.0:1789185635.693480:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c704 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.693497:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c704 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.693506:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c704 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.693513:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185635.693519:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c704 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.693528:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c704 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.693564:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c79055ddf00) 00010000:00010000:0.0:1789185635.693567:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185635.693575:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c704 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.693582:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272c704 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185635.693821:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812405376 00000100:00100000:3.0:1789185635.693834:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812405376 00000100:00100000:3.0:1789185635.693919:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:3.0:1789185635.693933:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812405376:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1789185635.693957:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185635.693981:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e183023/0x532743011272c719 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d7ba expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789185635.694014:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789185635.694041:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=332s v=(0 0) 00010000:00010000:3.0:1789185635.694046:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185635.694057:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e183023/0x532743011272c719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7ba expref: 6 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.694079:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e183023/0x532743011272c719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7ba expref: 6 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.694105:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04400, rc 0) 00000100:00100000:3.0:1789185635.694175:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2370:x1876096812405376:12345-192.168.202.54@tcp:101:bash.0 Request processed in 245us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185635.694183:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00080000:2.0:1789185635.694838:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185635.700615:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.700738:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812405504 00000100:00100000:0.0:1789185635.700752:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812405504 00000100:00100000:0.0:1789185635.700827:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:0.0:1789185635.700840:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:11588:x1876096812405504:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1789185635.700864:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185635.700890:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d7c1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.700934:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e183023/0x532743011272c719 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7ba expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.700945:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185635.700951:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185635.700958:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.701004:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e183023/0x532743011272c719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7ba expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.701049:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e183023/0x532743011272c719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7ba expref: 7 pid: 6676 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185635.701067:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1876096821832832:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789185635.701195:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905310000 going to sleep for 11 seconds 00000100:00100000:2.0:1789185635.705026:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.705158:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1876096821832832:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185635.705202:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.705228:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355600, rc 0) 00000100:00100000:0.0:1789185635.705315:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:11588:x1876096812405504:12345-192.168.202.54@tcp:101:bash.0 Request processed in 4478us (4715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185635.705326:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:3.0:1789185635.705530:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812405632 00000100:00100000:3.0:1789185635.705539:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812405632 00010000:00010000:3.0:1789185635.705593:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e183023/0x532743011272c719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7ba expref: 7 pid: 6676 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185635.705657:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:3.0:1789185635.705668:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2372:x1876096812405632:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185635.705688:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185635.705717:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e183023/0x532743011272c719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7ba expref: 7 pid: 6676 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.705732:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e183023/0x532743011272c719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7ba expref: 7 pid: 6676 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.705761:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e183023/0x532743011272c719 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7ba expref: 7 pid: 6676 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.705780:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185635.705785:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185635.705795:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.705807:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.705850:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185635.705867:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7803236680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1876096821832960:192.168.202.54@tcp:105: 00000100:00100000:3.0:1789185635.705941:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78039a6240 going to sleep for 11 seconds 00000100:00100000:2.0:1789185635.711345:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.711525:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812405888 00000100:00100000:0.0:1789185635.711538:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812405888 00000100:00100000:0.0:1789185635.711622:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:0.0:1789185635.711636:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+38:11588:x1876096812405888:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:0.0:1789185635.712544:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+39:11588:x1876096812405888:12345-192.168.202.54@tcp:35:bash.0 Request processed in 904us (1206us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789185635.712557:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:3.0:1789185635.713471:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7803236680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1876096821832960:192.168.202.54@tcp:105: 00010000:00010000:3.0:1789185635.713508:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185635.713556:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2372:x1876096812405632:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 7890us (8544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185635.713568:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:2.0:1789185635.836847:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.837275:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812406016 00000100:00100000:0.0:1789185635.837289:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812406016 00000100:00100000:0.0:1789185635.837373:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 199 00000100:00100000:0.0:1789185635.837386:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+39:11604:x1876096812406016:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789185635.837496:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185635.837524:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c727 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d7c8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.837760:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c72e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.837779:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c72e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.837795:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c72e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185635.837842:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789185635.837846:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185635.837868:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c72e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.837896:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c727 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c8 expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.837917:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c72e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c8 expref: 40 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.837926:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:0.0:1789185635.837929:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185635.837934:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354600, rc 0) 00000100:00100000:0.0:1789185635.838017:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+40:11604:x1876096812406016:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 633us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185635.838025:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 199 00000100:00100000:1.0:1789185635.845725:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185635.845868:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812406272 00000100:00100000:3.0:1789185635.845881:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812406272 00000100:00100000:3.0:1789185635.845962:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00100000:3.0:1789185635.845975:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+40:11604:x1876096812406272:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185635.846005:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185635.846034:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c735 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d7cf expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.846289:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c73c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.846307:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c73c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.846323:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c73c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185635.846337:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789185635.847975:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c735 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7cf expref: 43 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.848009:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c73c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7cf expref: 42 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.848039:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c79055dd100) 00010000:00010000:3.0:1789185635.848042:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185635.848047:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04800, rc 0) 00000100:00100000:3.0:1789185635.849067:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+42:11604:x1876096812406272:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 3074us (3336us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1789185635.849088:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00100000:2.0:1789185635.852532:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185635.853423:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812406656 00000100:00100000:3.0:1789185635.853453:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812406656 00000100:00100000:3.0:1789185635.853761:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:3.0:1789185635.853778:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793081c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+42:2369:x1876096812406656:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185635.853803:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185635.853841:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04800/0x532743011272c73c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7cf expref: 42 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.853867:0:6692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c79055dd100) 00010000:00010000:3.0:1789185635.853875:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185635.853969:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793081c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+41:2369:x1876096812406656:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 197us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185635.853978:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:2.0:1789185635.858750:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.858859:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812406528 00000100:00100000:0.0:1789185635.858873:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812406528 00000100:00100000:0.0:1789185635.858953:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 201 00000100:00100000:0.0:1789185635.858967:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+41:11604:x1876096812406528:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789185635.859006:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185635.859036:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c74a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d7d6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.859174:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c751 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.859194:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.859210:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185635.859226:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789185635.859394:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c74a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7d6 expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.859459:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c751 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7d6 expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.859469:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c79055dd100) 00010000:00010000:0.0:1789185635.859473:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789185635.859477:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354e00, rc 0) 00000100:00100000:0.0:1789185635.859560:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+43:11604:x1876096812406528:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 596us (826us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1789185635.859589:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 201 00000100:00100000:2.0:1789185635.872114:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185635.872276:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812406784 00000100:00100000:3.0:1789185635.872289:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812406784 00000100:00100000:3.0:1789185635.872364:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:3.0:1789185635.872375:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+6:2371:x1876096812406784:12345-192.168.202.54@tcp:1:lfs.0 00010000:00010000:3.0:1789185635.872496:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c46e77cf/0x532743011272c75f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.872546:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185635.872765:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185635.872772:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185635.872778:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c46e77cf/0x532743011272c75f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.873133:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.873154:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 6 pid: 6679 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185635.873171:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc85f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1876096821833088:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185635.873367:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c792f6a1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789185635.877155:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc85f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1876096821833088:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185635.877201:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c46e77cf/0x532743011272c75f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185635.878294:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185635.878454:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812406912 00000100:00100000:1.0:1789185635.878466:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812406912 00002000:00100000:1.0:1789185635.878535:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9c793fc87b80 x1876096812406912/t0(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:236/0 lens 504/0 e 0 to 0 dl 1789185646 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789185635.878547:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c793fc87b80 with x1876096812406912 ext(0->8) 00010000:00010000:1.0:1789185635.878567:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 7 pid: 6679 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.878608:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 7 pid: 6679 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789185635.878618:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c793fc87b80 00000100:00100000:1.0:1789185635.878656:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:1.0:1789185635.878667:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2371:x1876096812406912:12345-192.168.202.54@tcp:4:lfs.0 00000100:00100000:1.0:1789185635.879325:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2371:x1876096812406912:12345-192.168.202.54@tcp:4:lfs.0 Request processed in 654us (1033us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789185635.879335:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00002000:00100000:1.0:1789185635.879344:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9c793fc87b80 x1876096812406912/t4294967308(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:236/0 lens 504/448 e 0 to 0 dl 1789185646 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789185635.879353:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c793fc87b80 with x1876096812406912 ext(0->8) 00010000:00010000:1.0:1789185635.879360:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 9 pid: 6679 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.879378:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 9 pid: 6679 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789185635.879386:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c793fc87b80 00000100:00100000:2.0:1789185635.882095:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185635.882341:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812407040 00000100:00100000:1.0:1789185635.882354:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812407040 00010000:00010000:1.0:1789185635.882448:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 9 pid: 6679 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185635.882578:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:1.0:1789185635.882590:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2369:x1876096812407040:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185635.882611:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789185635.882639:0:5809:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789185635.882642:0:5809:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789185635 00002000:00010000:1.0:1789185635.882646:0:5809:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789185635 00002000:00010000:1.0:1789185635.882648:0:5809:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789185635 00010000:00010000:1.0:1789185635.882655:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 9 pid: 6679 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.882673:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 9 pid: 6679 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.882702:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f070623a/0x532743011272c720 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c1 expref: 9 pid: 6679 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.882725:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185635.882729:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185635.882736:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c46e77cf/0x532743011272c75f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.882746:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c46e77cf/0x532743011272c75f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.882775:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185635.882858:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2369:x1876096812407040:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 270us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185635.882867:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 75 00010000:00010000:0.0:1789185635.883140:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c46e77cf/0x532743011272c75f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.883151:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c46e77cf/0x532743011272c75f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.883182:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c46e77cf/0x532743011272c75f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.883191:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c46e77cf/0x532743011272c75f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.883201:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c46e77cf/0x532743011272c75f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.883208:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04800 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185635.883214:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c46e77cf/0x532743011272c75f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.883223:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c46e77cf/0x532743011272c75f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.883246:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c46e77cf/0x532743011272c75f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.883253:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c46e77cf/0x532743011272c75f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185635.883331:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2371:x1876096812406784:12345-192.168.202.54@tcp:1:lfs.0 Request processed in 10956us (11233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185635.883341:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:2.0:1789185635.887250:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.887363:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812407296 00000100:00100000:0.0:1789185635.887379:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812407296 00000100:00100000:0.0:1789185635.887521:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:0.0:1789185635.887534:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791916c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+43:11604:x1876096812407296:12345-192.168.202.54@tcp:35:lfs.0 00000004:00010000:0.0:1789185635.887639:0:5825:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c751 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7d6 expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789185635.887965:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1789185635.888006:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1789185635.888960:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1789185635.889052:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c766 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.889265:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c70b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7b3 expref: 47 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.889278:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c766 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.889348:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c70b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7b3 expref: 47 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.889369:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c70b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7b3 expref: 47 pid: 11024 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185635.889387:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1876096821833216:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789185635.889628:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905310900 going to sleep for 11 seconds 00000100:00100000:2.0:1789185635.893454:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185635.894127:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1876096821833216:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185635.894172:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c766 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185635.894555:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812407424 00000100:00100000:3.0:1789185635.894677:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812407424 00010000:00010000:2.0:1789185635.894856:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c70b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7b3 expref: 48 pid: 11024 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185635.894949:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:2.0:1789185635.894962:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+48:2372:x1876096812407424:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185635.894983:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185635.894992:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c70b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7b3 expref: 48 pid: 11024 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.895029:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c70b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7b3 expref: 48 pid: 11024 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.895069:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272c70b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7b3 expref: 48 pid: 11024 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.895213:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c79055dd100) 00010000:00010000:2.0:1789185635.895221:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c766 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.895234:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.895246:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c766 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185635.895291:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185635.895542:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.895553:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789185635.895744:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1789185635.895999:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1789185635.896168:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1876096821833344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789185635.896251:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185635.896309:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905310b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185635.896398:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821833344 00000100:00100000:2.0:1789185635.896608:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+49:2372:x1876096812407424:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 1644us (3163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185635.896621:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:0.0:1789185635.896935:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821833344 00000100:00100000:0.0:1789185635.896997:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789185635.897007:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1876096821833344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789185635.897221:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1876096821833344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 215us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185635.897230:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789185635.897287:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1876096821833344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789185635.899811:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1789185635.899975:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1876096821833472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789185635.901213:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185635.901270:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905310900 going to sleep for 11 seconds 00000100:00100000:3.0:1789185635.901359:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821833472 00000100:00100000:3.0:1789185635.901371:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821833472 00000100:00100000:3.0:1789185635.901477:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789185635.901490:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1876096821833472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789185635.901796:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5825:x1876096821833472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 309us (1739us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789185635.901805:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789185635.901940:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1876096821833472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789185635.902033:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1789185635.902296:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.902308:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c766 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.902317:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c766 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.902325:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185635.902330:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c766 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.902340:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c766 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.902362:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c79055dd100) 00010000:00010000:0.0:1789185635.902365:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789185635.902391:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c766 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185635.902398:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c766 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789185635.903597:0:5825:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789185635.903733:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1789185635.903747:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332943341148ns, next at 333943338010ns, rc = 0 00000001:00080000:0.0:1789185635.903758:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1789185635.903825:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c79055dd100) 00010000:00010000:0.0:1789185635.903830:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789185635.903842:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c751 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7d6 expref: 51 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185635.904075:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791916c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+50:11604:x1876096812407296:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 16542us (16837us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789185635.904095:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 56 00000020:00080000:0.0:1789185635.904102:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789185635.906642:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185635.906730:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812407552 00000100:00100000:1.0:1789185635.906742:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812407552 00000100:00100000:1.0:1789185635.906855:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 202 00000100:00100000:1.0:1789185635.906867:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+50:11604:x1876096812407552:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789185635.906897:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185635.906925:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c76d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d7dd expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.907003:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c76d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7dd expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.907021:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c76d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7dd expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185635.907042:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:1.0:1789185635.907046:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789185635.907051:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4d400, rc 0) 00000100:00100000:1.0:1789185635.907276:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+51:11604:x1876096812407552:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 410us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185635.907285:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 202 00000100:00100000:2.0:1789185635.913016:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185635.913287:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812407808 00000100:00100000:1.0:1789185635.913300:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812407808 00000100:00100000:1.0:1789185635.913373:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:1.0:1789185635.913386:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+51:11604:x1876096812407808:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1789185635.913780:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+52:11604:x1876096812407808:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 395us (779us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789185635.913788:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:2.0:1789185636.004588:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185636.004770:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812407936 00000100:00100000:0.0:1789185636.004785:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812407936 00000100:00100000:0.0:1789185636.004862:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 203 00000100:00100000:0.0:1789185636.004876:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+52:11615:x1876096812407936:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:0.0:1789185636.004995:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c774 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005018:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c774 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005036:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c774 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005092:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c77b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005101:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c77b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005108:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c77b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005222:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c782 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005231:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005239:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789185636.005297:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005313:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c774 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005320:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c774 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005336:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c774 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005343:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185636.005348:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c774 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005365:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c774 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005381:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:0.0:1789185636.005384:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185636.005390:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c774 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005397:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c774 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005477:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c77b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005485:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c77b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005491:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c77b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005496:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185636.005499:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c77b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005505:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c77b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005512:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c79117a4900) 00010000:00010000:0.0:1789185636.005515:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185636.005517:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c77b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005535:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c77b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005552:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005559:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c782 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005565:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c782 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005570:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185636.005574:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c782 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005579:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c782 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005587:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:0.0:1789185636.005589:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185636.005592:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c782 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.005597:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c782 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185636.005690:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+52:11615:x1876096812407936:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 816us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185636.005700:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 203 00000100:00100000:2.0:1789185636.067113:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185636.067267:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812408192 00000100:00100000:3.0:1789185636.067282:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812408192 00000100:00100000:3.0:1789185636.067376:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 204 00000100:00100000:3.0:1789185636.067390:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+52:11618:x1876096812408192:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185636.067469:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185636.067500:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c789 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d7e4 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.067794:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c790 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.067831:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c790 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.067847:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c790 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.067866:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c797 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.067874:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.067880:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068040:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c79e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068049:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068127:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185636.068140:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789185636.068296:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c790 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068305:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c790 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068313:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c790 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068487:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185636.068494:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c790 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068504:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c790 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068520:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:3.0:1789185636.068523:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185636.068529:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c790 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068536:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c790 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068553:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068627:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c797 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068633:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c797 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068639:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185636.068642:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c797 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068649:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c797 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068669:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c79055dd100) 00010000:00010000:3.0:1789185636.068672:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185636.068676:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c797 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068682:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c797 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068739:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c789 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7e4 expref: 55 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068756:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c79e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7e4 expref: 54 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.068763:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:3.0:1789185636.068765:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185636.068768:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05200, rc 0) 00000100:00100000:3.0:1789185636.068860:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+54:11618:x1876096812408192:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1474us (1762us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789185636.068870:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 204 00000100:00100000:2.0:1789185636.083020:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185636.083204:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812408320 00000100:00100000:0.0:1789185636.083220:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812408320 00000100:00100000:0.0:1789185636.083300:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 205 00000100:00100000:0.0:1789185636.083312:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+54:11618:x1876096812408320:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:0.0:1789185636.083455:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.083476:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.083492:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.083526:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.083533:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.083541:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.083548:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185636.083553:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.083561:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.083575:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:0.0:1789185636.083578:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789185636.083584:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.083610:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185636.083708:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+54:11618:x1876096812408320:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 398us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185636.083717:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 205 00000100:00100000:2.0:1789185636.089569:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185636.089685:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812408576 00000100:00100000:1.0:1789185636.089699:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812408576 00000100:00100000:1.0:1789185636.089771:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:1.0:1789185636.089785:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+54:11618:x1876096812408576:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1789185636.090129:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+55:11618:x1876096812408576:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 345us (585us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789185636.090138:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:2.0:1789185636.251045:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185636.251225:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812408832 00000100:00100000:1.0:1789185636.251239:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812408832 00000100:00100000:1.0:1789185636.251318:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 206 00000100:00100000:1.0:1789185636.251342:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+55:11628:x1876096812408832:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789185636.251385:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185636.251389:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789185636.251507:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272c72e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7c8 expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.251533:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:1.0:1789185636.251540:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185636.251558:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c7b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d7eb expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.251699:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c7ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.251741:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c7ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.251754:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c7ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185636.251767:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789185636.251929:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c7b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7eb expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.251946:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c7ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7eb expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.251954:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:1.0:1789185636.251957:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185636.251960:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4c400, rc 0) 00000100:00100000:1.0:1789185636.252048:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+56:11628:x1876096812408832:12345-192.168.202.54@tcp:101:bash.0 Request processed in 719us (1018us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789185636.252056:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 206 00000100:00100000:2.0:1789185636.259501:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185636.259830:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812409088 00000100:00100000:0.0:1789185636.259845:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812409088 00000100:00100000:0.0:1789185636.259918:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 207 00000100:00100000:0.0:1789185636.259931:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+56:11628:x1876096812409088:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:0.0:1789185636.260255:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789185636.260290:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c400/0x532743011272c7ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7eb expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.260316:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c79e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7e4 expref: 55 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.260335:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:0.0:1789185636.260342:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185636.260862:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.260881:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.260893:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789185636.262544:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1789185636.263549:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000059797a35 reply state 000000005746f2e5 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185636.264028:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789185636.264727:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+57:11628:x1876096812409088:12345-192.168.202.54@tcp:36:bash.0 Request processed in 4790us (5232us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789185636.264739:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 207 00000020:00080000:0.0:1789185636.264747:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789185636.269135:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.269160:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.269169:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.269177:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185636.269183:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.269193:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.269215:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:0.0:1789185636.269219:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185636.269226:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.269234:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272c7c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185636.272063:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185636.272192:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812409216 00000100:00100000:1.0:1789185636.272207:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812409216 00000100:00100000:1.0:1789185636.272284:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 208 00000100:00100000:1.0:1789185636.272296:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+56:11628:x1876096812409216:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1789185636.272327:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185636.272356:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c7cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d7f2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.272553:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c7d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.272571:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.272587:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185636.272625:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789185636.272630:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789185636.272655:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.272686:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c7cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7f2 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.272706:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7f2 expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.272715:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:1.0:1789185636.272718:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185636.272723:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4c600, rc 0) 00000100:00100000:1.0:1789185636.273864:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+57:11628:x1876096812409216:12345-192.168.202.54@tcp:101:bash.0 Request processed in 1560us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185636.273876:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 208 00000100:00100000:2.0:1789185636.278830:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185636.278935:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812409472 00000100:00100000:1.0:1789185636.279170:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812409472 00000100:00100000:1.0:1789185636.279307:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:1.0:1789185636.279321:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+57:11628:x1876096812409472:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:1.0:1789185636.279701:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+58:11628:x1876096812409472:12345-192.168.202.54@tcp:35:bash.0 Request processed in 382us (885us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789185636.279711:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:2.0:1789185636.386062:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185636.386204:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812409600 00000100:00100000:1.0:1789185636.386218:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812409600 00000100:00100000:1.0:1789185636.386306:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 209 00000100:00100000:1.0:1789185636.386320:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+58:11634:x1876096812409600:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789185636.386363:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185636.386401:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c7dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d7f9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.386556:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c7e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.386576:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.386592:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185636.386641:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789185636.386646:0:5822:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789185636.386670:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.386702:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c7dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7f9 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.386743:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c7e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7f9 expref: 59 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.386754:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:1.0:1789185636.386757:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789185636.386763:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4d000, rc 0) 00000100:00100000:1.0:1789185636.386836:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+59:11634:x1876096812409600:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 519us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185636.386844:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 209 00000100:00100000:2.0:1789185636.398564:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185636.398761:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812409728 00000100:00100000:3.0:1789185636.398774:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812409728 00000100:00100000:3.0:1789185636.398856:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 210 00000100:00100000:3.0:1789185636.398870:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+59:11634:x1876096812409728:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185636.398897:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185636.398927:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c7eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d800 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.399043:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c7f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.399208:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.399225:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.399245:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c7f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.399252:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.399259:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.399387:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c800 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.399397:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400228:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185636.400296:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789185636.400302:0:11024:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789185636.400338:0:11024:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400376:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400387:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400395:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c7f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400402:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400449:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185636.400454:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400463:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c7f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400478:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:3.0:1789185636.400481:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185636.400487:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c7f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400494:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c7f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400511:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400517:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c7f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400529:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400535:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185636.400537:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400543:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c7f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400551:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c79055dd100) 00010000:00010000:3.0:1789185636.400554:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185636.400557:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c7f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400564:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c7f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400618:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c7eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d800 expref: 61 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400636:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c800 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d800 expref: 60 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.400643:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:3.0:1789185636.400645:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185636.400649:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05a00, rc 0) 00000100:00100000:3.0:1789185636.400771:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+60:11634:x1876096812409728:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1902us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185636.400792:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 210 00000100:00100000:2.0:1789185636.415090:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185636.415136:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185636.415218:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812410112 00000100:00100000:1.0:1789185636.415232:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812410112 00000100:00100000:1.0:1789185636.415310:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 211 00000100:00100000:1.0:1789185636.415327:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+60:11634:x1876096812410112:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1789185636.415367:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185636.415397:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c807 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d807 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.415584:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.415602:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c7d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7f2 expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.415612:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c800 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d800 expref: 61 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.415644:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.415693:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c800 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d800 expref: 61 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.415712:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c800 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d800 expref: 61 pid: 11024 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185636.415729:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821833600:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789185636.416063:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7f2 expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.416073:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c7d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7f2 expref: 61 pid: 5823 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185636.416083:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821833728:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789185636.416111:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7910fcbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185636.420771:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812409984 00000100:00100000:3.0:1789185636.420794:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812409984 00010000:00010000:3.0:1789185636.421166:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c800 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d800 expref: 62 pid: 11024 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185636.421225:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:3.0:1789185636.421237:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+62:2370:x1876096812409984:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185636.421257:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185636.421266:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c800 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d800 expref: 62 pid: 11024 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.421283:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c800 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d800 expref: 62 pid: 11024 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.421310:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:3.0:1789185636.421317:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.421330:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.421337:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185636.421482:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+62:2370:x1876096812409984:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 243us (6403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185636.421489:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:2.0:1789185636.421899:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185636.421929:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812410240 00000100:00100000:2.0:1789185636.421934:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812410240 00010000:00010000:2.0:1789185636.421978:0:6692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c7d6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7f2 expref: 62 pid: 5823 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185636.422004:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:2.0:1789185636.422012:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+62:2371:x1876096812410240:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185636.422023:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185636.422029:0:6692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c7d6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7f2 expref: 62 pid: 5823 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.422040:0:6692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c7d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7f2 expref: 62 pid: 5823 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.422054:0:6692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:2.0:1789185636.422058:0:6692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.422068:0:6692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.422077:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.422119:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185636.422151:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+62:2371:x1876096812410240:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 140us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185636.422158:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 78 00010000:00010000:3.0:1789185636.426053:0:5822:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.54@tcp) returned -22 from blocking AST (req@0000000036e97d06 x1876096821833600) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c800 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d800 expref: 61 pid: 11024 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.426103:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c800 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d800 expref: 61 pid: 11024 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185636.426127:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821833600:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185636.426150:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c600/0x532743011272c7d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7f2 expref: 60 pid: 5823 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185636.426161:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821833728:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185636.426192:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:3.0:1789185636.426208:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.426219:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.426226:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185636.426260:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789185636.427953:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272c807 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d807 expref: 61 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.427988:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d807 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.427999:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:3.0:1789185636.428023:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789185636.428028:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4ca00, rc 0) 00000100:00100000:3.0:1789185636.428127:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+60:11634:x1876096812410112:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 12801us (12989us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789185636.428139:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 211 00000100:00100000:2.0:1789185636.431679:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185636.431801:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812410496 00000100:00100000:3.0:1789185636.431812:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812410496 00000100:00100000:3.0:1789185636.431879:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:3.0:1789185636.431887:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+60:11634:x1876096812410496:12345-192.168.202.54@tcp:103:lfs.0 00010000:00010000:3.0:1789185636.431903:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185636.431930:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c76d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7dd expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.431960:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:3.0:1789185636.431967:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185636.432026:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+59:11634:x1876096812410496:12345-192.168.202.54@tcp:103:lfs.0 Request processed in 140us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185636.432032:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:2.0:1789185636.435844:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185636.435944:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812410624 00000100:00100000:1.0:1789185636.435957:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812410624 00000100:00100000:1.0:1789185636.436025:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:1.0:1789185636.436036:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+59:11634:x1876096812410624:12345-192.168.202.54@tcp:58:lfs.0 00010000:00010000:1.0:1789185636.436187:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c81c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.436206:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c81c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.436226:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c81c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789185636.436512:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789185636.436605:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+59:11634:x1876096812410624:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 570us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185636.436613:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:1.0:1789185636.439948:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185636.440081:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812410752 00000100:00100000:0.0:1789185636.440094:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812410752 00000100:00100000:0.0:1789185636.440202:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 213 00000100:00100000:0.0:1789185636.440215:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+59:11634:x1876096812410752:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789185636.440243:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185636.440273:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c823 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d80e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.440360:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c81c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.440383:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c823 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d80e expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.440451:0:5824:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c81c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.440468:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c823 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d80e expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.440485:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:0.0:1789185636.440488:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789185636.440492:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c823 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d80e expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.440500:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355000, rc 0) 00000100:00100000:0.0:1789185636.440574:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+60:11634:x1876096812410752:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 362us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185636.440601:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 213 00010000:00010000:1.0:1789185636.496941:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789185636.881111:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185636.881127:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185636.881221:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1789185636.881229:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789185636.881609:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7803235f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1876096821833856:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789185636.881855:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78039a6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185636.892691:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7803235f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1876096821833856:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789185636.893277:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185636.893915:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812410880 00000100:00100000:1.0:1789185636.893930:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812410880 00000100:00100000:1.0:1789185636.894021:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 214 00000100:00100000:1.0:1789185636.894035:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+60:11635:x1876096812410880:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789185636.894092:0:5823:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789185636.894260:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+60:11635:x1876096812410880:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 226us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185636.894269:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 214 00000100:00100000:1.0:1789185636.897766:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185636.903006:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812411008 00000100:00100000:3.0:1789185636.903082:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812411008 00000100:00100000:3.0:1789185636.903226:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 215 00000100:00100000:3.0:1789185636.903241:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+60:11635:x1876096812411008:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789185636.903830:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c82a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.903856:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c82a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.903870:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c82a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.903890:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c831 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.903898:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c831 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.903904:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c831 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.903934:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c838 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.903943:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.903949:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185636.904013:0:5822:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789185636.904019:0:5822:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789185636.904384:0:5822:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904402:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c82a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904448:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c82a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904457:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c82a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904463:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185636.904468:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c82a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904476:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c82a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904490:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c792334af00) 00010000:00010000:3.0:1789185636.904493:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185636.904500:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c82a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904507:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c82a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904524:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c831 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904530:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c831 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904536:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c831 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904551:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185636.904554:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c831 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904571:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c831 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904580:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9c79055dd100) 00010000:00010000:3.0:1789185636.904582:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185636.904585:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c831 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904591:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c831 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904609:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904616:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c838 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904621:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904627:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185636.904629:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904635:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c838 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904653:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:3.0:1789185636.904656:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185636.904659:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c838 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.904664:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c838 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185636.905710:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+60:11635:x1876096812411008:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 Request processed in 2459us (7944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185636.905740:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 215 00000100:00100000:2.0:1789185636.913037:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185636.913291:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812411264 00000100:00100000:1.0:1789185636.913306:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812411264 00000100:00100000:1.0:1789185636.913564:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 216 00000100:00100000:1.0:1789185636.913579:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+60:11635:x1876096812411264:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185636.913609:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185636.913641:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c83f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d815 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.913825:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c846 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.913846:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.913863:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185636.913877:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789185636.914030:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.914039:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c846 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.914059:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.914067:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185636.914080:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.914090:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c846 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.914106:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:1.0:1789185636.914109:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789185636.914116:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c846 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.914136:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272c846 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.914194:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c83f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d815 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.914206:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c792334af00) 00010000:00010000:1.0:1789185636.914209:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789185636.914213:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272c83f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d815 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.914224:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4ce00, rc 0) 00000100:00100000:1.0:1789185636.914328:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+61:11635:x1876096812411264:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 753us (1388us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1789185636.914337:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 216 00000100:00100000:2.0:1789185636.918784:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185636.918872:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812411392 00000100:00100000:0.0:1789185636.918885:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812411392 00000100:00100000:0.0:1789185636.918946:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 217 00000100:00100000:0.0:1789185636.918958:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+61:11635:x1876096812411392:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789185636.919008:0:5824:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789185636.919219:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+61:11635:x1876096812411392:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 262us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185636.919228:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 217 00000100:00100000:2.0:1789185636.922093:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185636.922261:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812411648 00000100:00100000:3.0:1789185636.922274:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812411648 00000100:00100000:3.0:1789185636.922354:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 218 00000100:00100000:3.0:1789185636.922368:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+61:11635:x1876096812411648:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185636.922398:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185636.922402:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789185636.922482:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d000/0x532743011272c7e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d7f9 expref: 61 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.922728:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:3.0:1789185636.922735:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185636.922829:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c854 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d81c expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789185636.923949:0:11024:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1789185636.924206:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c85b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.924222:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c85b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.924232:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c85b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.924793:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c854 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d81c expref: 63 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.924817:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c85b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d81c expref: 62 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.924842:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c792334a500) 00010000:00010000:2.0:1789185636.924845:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185636.924848:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073ffc00, rc 0) 00000100:00100000:2.0:1789185636.924965:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+62:11635:x1876096812411648:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 2600us (2889us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789185636.924973:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 218 00000100:00100000:2.0:1789185636.928764:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185636.928833:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812411904 00000100:00100000:3.0:1789185636.928845:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812411904 00000100:00100000:3.0:1789185636.928908:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:3.0:1789185636.928920:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+62:11635:x1876096812411904:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789185636.929001:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185636.929053:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c85b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d81c expref: 62 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929077:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c792334a500) 00010000:00010000:3.0:1789185636.929091:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185636.929121:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c869 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929138:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c869 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929152:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c869 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929166:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c870 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xee9a38d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929171:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c870 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xee9a38d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929176:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c870 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xee9a38d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929249:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c869 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929254:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c869 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929259:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c869 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929262:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185636.929271:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c869 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929278:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c869 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929284:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:3.0:1789185636.929286:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185636.929289:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c869 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929294:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c869 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929300:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c870 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xee9a38d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929304:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c870 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xee9a38d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929307:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c870 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xee9a38d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929312:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185636.929315:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c870 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xee9a38d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929321:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c870 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xee9a38d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929328:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xee9a38d8 (ffff9c79055dd100) 00010000:00010000:3.0:1789185636.929330:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185636.929339:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c870 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xee9a38d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.929345:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c870 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xee9a38d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185636.929794:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+61:11635:x1876096812411904:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 874us (1042us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789185636.929801:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:3.0:1789185636.931890:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185636.932260:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812412032 00000100:00100000:1.0:1789185636.932270:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812412032 00000100:00100000:2.0:1789185636.932476:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 220 00000100:00100000:2.0:1789185636.932659:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+61:11635:x1876096812412032:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185636.932689:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185636.932721:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c877 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d823 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.932771:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c87e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.932790:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c87e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.932803:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c87e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.932916:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c877 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d823 expref: 63 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.932939:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c87e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d823 expref: 62 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.932946:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c792334a000) 00010000:00010000:2.0:1789185636.932949:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789185636.932952:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073ff000, rc 0) 00000100:00100000:2.0:1789185636.933024:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+62:11635:x1876096812412032:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 537us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185636.933032:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 220 00000100:00100000:1.0:1789185636.935961:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185636.936133:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812412288 00000100:00100000:0.0:1789185636.936144:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812412288 00000100:00100000:0.0:1789185636.936205:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 221 00000100:00100000:0.0:1789185636.936217:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+62:11635:x1876096812412288:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789185636.936492:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c885 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.936516:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c885 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.936531:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c885 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789185636.936861:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1789185636.936871:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 333976464978ns, next at 334976462283ns, rc = 0 00000004:00010000:0.0:1789185636.936970:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e511955f reply state 0000000056b647b1 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c885 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185636.936996:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789185636.937217:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+64:11635:x1876096812412288:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 998us (1263us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789185636.937225:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 221 00010000:00010000:2.0:1789185636.938919:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c885 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.938940:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c885 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.938949:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c885 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.938956:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185636.938962:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c885 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.938972:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c885 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.938990:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c792334a000) 00010000:00010000:2.0:1789185636.938994:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789185636.938999:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c885 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.939022:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c885 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185636.939961:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185636.940138:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812412416 00000100:00100000:0.0:1789185636.940152:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812412416 00000100:00100000:0.0:1789185636.940252:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 222 00000100:00100000:0.0:1789185636.940265:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+63:11635:x1876096812412416:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185636.940296:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185636.940321:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c88c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d82a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.940401:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c88c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d82a expref: 64 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.940472:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c88c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d82a expref: 64 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.940507:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c792334a000) 00010000:00010000:0.0:1789185636.940511:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789185636.940516:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355e00, rc 0) 00000100:00100000:0.0:1789185636.940605:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+64:11635:x1876096812412416:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 342us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185636.940613:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 222 00000100:00100000:0.0:1789185636.942903:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185636.942996:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812412544 00000100:00100000:3.0:1789185636.943006:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812412544 00000100:00100000:3.0:1789185636.943139:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:3.0:1789185636.943151:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2371:x1876096812412544:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789185636.943663:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+10:2371:x1876096812412544:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 513us (767us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789185636.943674:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:3.0:1789185636.946189:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185636.946241:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812412800 00000100:00100000:3.0:1789185636.946254:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812412800 00000100:00100000:3.0:1789185636.946329:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:3.0:1789185636.946340:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+64:11635:x1876096812412800:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789185636.946669:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+65:11635:x1876096812412800:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 329us (493us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789185636.946677:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00080000:2.0:1789185636.950316:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185636.952214:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185636.952313:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812413056 00000100:00100000:2.0:1789185636.952327:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812413056 00000100:00100000:2.0:1789185636.952460:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 223 00000100:00100000:2.0:1789185636.952476:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+65:11635:x1876096812413056:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789185636.952972:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+65:11635:x1876096812413056:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 495us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185636.953010:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 223 00000100:00100000:1.0:1789185636.958401:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185636.958831:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812413184 00000100:00100000:2.0:1789185636.958845:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812413184 00000100:00100000:2.0:1789185636.958931:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:2.0:1789185636.958945:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+65:11635:x1876096812413184:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185636.958974:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185636.959014:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c893 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d831 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.959136:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c89a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.959155:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c89a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.959171:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c89a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185636.959220:0:11024:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789185636.959246:0:11024:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c89a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.959307:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe800/0x532743011272c893 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d831 expref: 67 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.959329:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c89a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d831 expref: 66 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.959340:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c792334a000) 00010000:00010000:2.0:1789185636.959343:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789185636.959348:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073ffc00, rc 0) 00000100:00100000:2.0:1789185636.959492:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+66:11635:x1876096812413184:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 550us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185636.959501:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:3.0:1789185636.964270:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185636.964399:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812413312 00000100:00100000:0.0:1789185636.964467:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812413312 00000100:00100000:0.0:1789185636.964554:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:0.0:1789185636.964567:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+10:2372:x1876096812413312:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185636.964592:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185636.964622:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2aa3d3d/0x532743011272c8a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d838 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789185636.964659:0:6884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4ce64, blocks: 0x1 00010000:00010000:0.0:1789185636.964695:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=334s v=(0 0) 00010000:00010000:0.0:1789185636.964701:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185636.964713:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2aa3d3d/0x532743011272c8a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d838 expref: 11 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.964736:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2aa3d3d/0x532743011272c8a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d838 expref: 11 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185636.964754:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354200, rc 0) 00000100:00100000:0.0:1789185636.964825:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+11:2372:x1876096812413312:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 260us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185636.964834:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:0.0:1789185636.968473:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185636.968588:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812413568 00000100:00100000:2.0:1789185636.968601:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812413568 00000100:00100000:2.0:1789185636.968664:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 225 00000100:00100000:2.0:1789185636.968674:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+66:11635:x1876096812413568:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789185636.968811:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+66:11635:x1876096812413568:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 137us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185636.968820:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 225 00000100:00100000:1.0:1789185636.974913:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185636.975201:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812413696 00000100:00100000:3.0:1789185636.975214:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812413696 00000100:00100000:3.0:1789185636.975364:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:3.0:1789185636.975378:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+11:11635:x1876096812413696:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185636.975493:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185636.975520:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e183023/0x532743011272c8a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d83f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.975575:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2aa3d3d/0x532743011272c8a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d838 expref: 12 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.975587:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185636.975592:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185636.975598:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e183023/0x532743011272c8a8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d83f expref: 12 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.975641:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2aa3d3d/0x532743011272c8a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d838 expref: 12 pid: 6884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185636.975661:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2aa3d3d/0x532743011272c8a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d838 expref: 12 pid: 6884 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185636.975679:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7803237480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1876096821833984:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185636.975803:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78039a6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185636.978535:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7803237480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1876096821833984:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789185636.978586:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e183023/0x532743011272c8a8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d83f expref: 12 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185636.978644:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04400, rc 0) 00000100:00100000:1.0:1789185636.978729:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:11635:x1876096812413696:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 3352us (3831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185636.978740:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:1.0:1789185636.981673:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185636.985192:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812413824 00000100:00100000:2.0:1789185636.985661:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812413824 00010000:00010000:2.0:1789185636.985738:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2aa3d3d/0x532743011272c8a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d838 expref: 12 pid: 6884 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185636.985880:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:2.0:1789185636.985893:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f129c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:2371:x1876096812413824:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185636.985934:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185636.985967:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2aa3d3d/0x532743011272c8a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d838 expref: 12 pid: 6884 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.985986:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2aa3d3d/0x532743011272c8a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d838 expref: 12 pid: 6884 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.986028:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2aa3d3d/0x532743011272c8a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d838 expref: 12 pid: 6884 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.986050:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185636.986056:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185636.986067:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e183023/0x532743011272c8a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d83f expref: 11 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.986080:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e183023/0x532743011272c8a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d83f expref: 11 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185636.986134:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002e183023/0x532743011272c8a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d83f expref: 11 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185636.986153:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc82a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5810:1876096821834112:192.168.202.54@tcp:105: 00000100:00100000:2.0:1789185636.986279:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c792f6a1540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185636.994354:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185636.994499:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812413952 00000100:00100000:1.0:1789185636.994513:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812413952 00002000:00100000:1.0:1789185636.994595:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9c793fc80700 x1876096812413952/t0(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:237/0 lens 504/0 e 0 to 0 dl 1789185647 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789185636.994607:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c793fc80700 with x1876096812413952 ext(0->12) 00002000:00010000:1.0:1789185636.994615:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c793fc80700 00000100:00100000:1.0:1789185636.994658:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:1.0:1789185636.994670:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+12:2371:x1876096812413952:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789185636.995742:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:2371:x1876096812413952:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 Request processed in 1066us (1396us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789185636.995757:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00002000:00100000:1.0:1789185636.995768:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9c793fc80700 x1876096812413952/t4294967320(0) o4->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:237/0 lens 504/448 e 0 to 0 dl 1789185647 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789185636.995779:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c793fc80700 with x1876096812413952 ext(0->12) 00002000:00010000:1.0:1789185636.995786:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c793fc80700 00000100:00100000:0.0:1789185636.995991:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc82a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5810:1876096821834112:192.168.202.54@tcp:105: 00010000:00010000:0.0:1789185636.996043:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185636.996085:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f129c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:2371:x1876096812413824:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 10195us (14427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185636.996095:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:3.0:1789185637.004287:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185637.004691:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812414080 00000100:00100000:2.0:1789185637.004728:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812414080 00000100:00100000:2.0:1789185637.004842:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00100000:2.0:1789185637.004857:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+66:11635:x1876096812414080:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 00000100:00080000:3.0:1789185637.005334:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789185637.063896:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:0.0:1789185637.063918:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1789185637.063961:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789185637.063992:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c794215c180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789185637.064009:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7906509500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c794215c0c0 00000020:00080000:0.0:1789185637.064014:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7906509e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c792f624800 00000004:00080000:0.0:1789185637.064103:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1789185637.064134:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c792f6a10c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789185637.064137:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c793f580e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c792f6a1300 00000020:00080000:0.0:1789185637.064140:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c793f580c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c792f658800 00000001:00080000:0.0:1789185637.064148:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000020:00080000:0.0:1789185637.064933:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789185637.065282:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789185637.065509:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821834240:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789185637.065843:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185637.066206:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7803235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821834496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789185637.066242:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185637.066290:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7803235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821834368:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789185637.066979:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:11635:x1876096812414080:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 Request processed in 62119us (62700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185637.066993:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00100000:2.0:1789185637.072179:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821834240 00000100:00100000:2.0:1789185637.072208:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821834240 00000100:00100000:2.0:1789185637.072307:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821834496 00000100:00100000:2.0:1789185637.072311:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821834496 00000100:00100000:1.0:1789185637.072481:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789185637.072499:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1876096821834240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789185637.072639:0:6884:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1789185637.072691:0:6884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa4ce63, atime: 0x6aa4ce63, ctime: 0x6aa4ce63, blocks: 0x1 00010000:00010000:1.0:1789185637.072702:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272c8af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185637.072962:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185637.073205:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812414208 00000100:00100000:2.0:1789185637.073210:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812414208 00000100:00100000:2.0:1789185637.073231:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789185637.073241:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1876096821834496:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789185637.073644:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1789185637.073650:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185637.073661:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272c8af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.073686:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272c8af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.073701:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272c8af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.073711:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272c8af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185637.073806:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185637.073865:0:6678:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789185637.073878:0:6678:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:1.0:1789185637.075876:0:6884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789185637.076491:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821834368 00000100:00100000:0.0:1789185637.076508:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821834368 00002000:00010000:2.0:1789185637.077222:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789185637.077230:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789185636 00002000:00010000:2.0:1789185637.077234:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789185637.077236:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789185636 -> 1789185636 00002000:00010000:2.0:1789185637.077239:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789185637.078236:0:12523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:0.0:1789185637.078255:0:12523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+13:2372:x1876096812414208:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789185637.078690:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3278:x1876096821834496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5448us (12444us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789185637.078702:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789185637.079193:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789185637.079209:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3281:x1876096821834368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789185637.079238:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1789185637.079267:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272c8b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.080642:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c671 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d79e expref: 13 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.080670:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789185637.080678:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185637.080686:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272c8b6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.080845:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185637.080856:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272c8af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.080867:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c200 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185637.080873:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272c8af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.080889:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272c8af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.080917:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272c8af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.080927:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272c8af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.080958:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185637.080960:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185637.080962:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789185637.081396:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789185637.081439:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789185637.081680:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c671 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d79e expref: 13 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.081709:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c671 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d79e expref: 13 pid: 6679 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185637.081802:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876096821834624:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185637.081993:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c792f6a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185637.084168:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3280:x1876096821834240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11663us (18313us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789185637.084184:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:2.0:1789185637.084433:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7803235500/2, rc 0, transno 4294967321 00000100:00100000:2.0:1789185637.084443:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7803235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821834496:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1789185637.085908:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c793fc3d880/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789185637.085926:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821834240:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789185637.099065:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185637.099126:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812414336 00000100:00100000:3.0:1789185637.099137:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812414336 00010000:00010000:3.0:1789185637.099192:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c671 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d79e expref: 14 pid: 6679 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185637.099236:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:3.0:1789185637.099248:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793081c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:2371:x1876096812414336:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185637.099268:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185637.099275:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c671 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d79e expref: 14 pid: 6679 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.099294:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c671 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d79e expref: 14 pid: 6679 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.099326:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185637.099332:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185637.099339:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272c8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.099350:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272c8b6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.099376:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185637.099502:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793081c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+14:2371:x1876096812414336:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 255us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185637.099510:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 80 00010000:00010000:0.0:1789185637.099943:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272c671 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d79e expref: 13 pid: 6679 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185637.099962:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876096821834624:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185637.099991:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272c8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.100029:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272c8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.100037:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272c8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.100058:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272c8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.100073:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272c8b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.100098:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1789185637.103235:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7803235180/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789185637.103256:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7803235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821834368:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789185637.103362:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3281:x1876096821834368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24156us (30358us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789185637.103376:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:0.0:1789185637.104345:0:11163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185637.104361:0:11163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272c8b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.104379:0:11163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073ff600 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185637.104385:0:11163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272c8b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.104399:0:11163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272c8b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.104508:0:11163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272c8b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.104518:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272c8b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.106853:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185637.106863:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185637.106866:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789185637.142226:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1789185637.142261:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:3.0:1789185637.142268:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1789185637.142707:0:12523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2372:x1876096812414208:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 Request processed in 64449us (69738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185637.142723:0:12523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:3.0:1789185637.157195:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185637.157685:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812414592 00000100:00100000:2.0:1789185637.157699:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812414592 00000100:00100000:2.0:1789185637.157777:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 227 00000100:00100000:2.0:1789185637.157792:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:11635:x1876096812414592:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789185637.157874:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185637.157913:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c89a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d831 expref: 20 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.157956:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c792334a000) 00010000:00010000:2.0:1789185637.157963:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185637.158201:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c8bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.158220:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c8bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.158232:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c8bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185637.159078:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000867f8931 reply state 000000004b128801 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c8bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185637.159095:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789185637.159250:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:11635:x1876096812414592:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 1459us (2066us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1789185637.159261:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 227 00010000:00010000:0.0:1789185637.162908:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c8bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.162933:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c8bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.162942:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c8bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.162949:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fea00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185637.162955:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c8bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.162965:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c8bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.162989:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c792334a000) 00010000:00010000:0.0:1789185637.162993:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185637.163070:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c8bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.163104:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fea00/0x532743011272c8bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185637.166299:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185637.173609:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812414720 00000100:00100000:0.0:1789185637.173641:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812414720 00000100:00100000:1.0:1789185637.173958:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:1.0:1789185637.173973:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2371:x1876096812414720:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789185637.174323:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789185637.174328:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789185636 -> 1789185635 00002000:00010000:1.0:1789185637.174331:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789185635 00002000:00010000:1.0:1789185637.174334:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789185636 -> 1789185635 00002000:00010000:1.0:1789185637.174336:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789185637.174485:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2371:x1876096812414720:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 513us (8962us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789185637.174495:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:3.0:1789185637.178118:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185637.178576:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812414976 00000100:00100000:0.0:1789185637.178591:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812414976 00000100:00100000:0.0:1789185637.178682:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:0.0:1789185637.178695:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:11635:x1876096812414976:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789185637.178810:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c8c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.178832:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c87e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d823 expref: 20 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.178843:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c8c4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.178901:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c87e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d823 expref: 20 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.178921:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c87e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d823 expref: 20 pid: 11024 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185637.178941:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876096821834752:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789185637.179246:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905310000 going to sleep for 11 seconds 00000100:00100000:3.0:1789185637.185897:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876096821834752:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185637.185945:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c8c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185637.188948:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185637.189246:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812415104 00000100:00100000:2.0:1789185637.189263:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812415104 00010000:00010000:2.0:1789185637.189346:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c87e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d823 expref: 21 pid: 11024 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185637.189397:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:2.0:1789185637.189448:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:2372:x1876096812415104:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185637.189471:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185637.189480:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c87e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d823 expref: 21 pid: 11024 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.189501:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c87e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d823 expref: 21 pid: 11024 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.189544:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c87e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d823 expref: 21 pid: 11024 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.189599:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c792334a000) 00010000:00010000:2.0:1789185637.189607:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c8c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.189620:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c8c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.189630:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c8c4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.189676:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185637.189762:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:2372:x1876096812415104:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 317us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185637.189771:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 81 00010000:00010000:3.0:1789185637.190492:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c8c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.190507:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c8c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.190564:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c8c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.190586:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c8c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.190594:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c8c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.190601:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185637.190607:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c8c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.190619:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c8c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.190635:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c792334a000) 00010000:00010000:3.0:1789185637.190639:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789185637.190644:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c8c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.190651:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272c8c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185637.190749:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:11635:x1876096812414976:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 Request processed in 12052us (12643us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789185637.190760:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:2.0:1789185637.197754:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185637.197880:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812415232 00000100:00100000:1.0:1789185637.197895:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812415232 00000100:00100000:1.0:1789185637.198026:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:1.0:1789185637.198040:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7940efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2372:x1876096812415232:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789185637.198123:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e6dccfca/0x532743011272c8cb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.198149:0:6884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e183023/0x532743011272c8a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d83f expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.198160:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185637.198165:0:6884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185637.198172:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6dccfca/0x532743011272c8cb lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.198252:0:6884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e183023/0x532743011272c8a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d83f expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.198273:0:6884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e183023/0x532743011272c8a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d83f expref: 8 pid: 6678 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185637.198294:0:6884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f129c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6884:1876096821834880:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789185637.198836:0:6884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7910fcbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185637.202581:0:6884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f129c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6884:1876096821834880:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789185637.202634:0:6884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6dccfca/0x532743011272c8cb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185637.204940:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185637.205290:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812415360 00000100:00100000:3.0:1789185637.205303:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812415360 00010000:00010000:2.0:1789185637.205770:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e183023/0x532743011272c8a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d83f expref: 9 pid: 6678 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185637.205893:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:2.0:1789185637.205906:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+9:2372:x1876096812415360:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185637.205927:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185637.205959:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e183023/0x532743011272c8a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d83f expref: 9 pid: 6678 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.205978:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e183023/0x532743011272c8a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d83f expref: 9 pid: 6678 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.206041:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e183023/0x532743011272c8a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d83f expref: 9 pid: 6678 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.206079:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185637.206085:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185637.206093:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6dccfca/0x532743011272c8cb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.206105:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6dccfca/0x532743011272c8cb lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.206153:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185637.206334:0:6884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6dccfca/0x532743011272c8cb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.206346:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6dccfca/0x532743011272c8cb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.206382:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e6dccfca/0x532743011272c8cb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.206392:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6dccfca/0x532743011272c8cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.206450:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6dccfca/0x532743011272c8cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.206459:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4dc00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185637.206464:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6dccfca/0x532743011272c8cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.206476:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6dccfca/0x532743011272c8cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.206491:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6dccfca/0x532743011272c8cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.206500:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6dccfca/0x532743011272c8cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185637.206881:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2372:x1876096812415360:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 974us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185637.206893:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:1.0:1789185637.207124:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7940efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2372:x1876096812415232:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 Request processed in 9086us (9387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185637.207133:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:2.0:1789185637.212813:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185637.212919:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812415616 00000100:00100000:0.0:1789185637.212932:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812415616 00000100:00100000:0.0:1789185637.213035:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 229 00000100:00100000:0.0:1789185637.213047:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:11635:x1876096812415616:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789185637.213162:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c8d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.213183:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c8d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.213197:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c8d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.214881:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c8d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.214912:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c88c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d82a expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.214923:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c8d9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.214972:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c88c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d82a expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.215028:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c88c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d82a expref: 20 pid: 5823 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185637.215057:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc80380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821835008:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185637.215186:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c792f6a1540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185637.219260:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc80380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821835008:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789185637.219303:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c8d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185637.220218:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185637.220631:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812415744 00000100:00100000:2.0:1789185637.220643:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812415744 00010000:00010000:2.0:1789185637.220700:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c88c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d82a expref: 21 pid: 5823 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185637.220748:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:2.0:1789185637.220759:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:2372:x1876096812415744:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185637.220780:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185637.220789:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c88c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d82a expref: 21 pid: 5823 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.220808:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c88c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d82a expref: 21 pid: 5823 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.220836:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c88c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d82a expref: 21 pid: 5823 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.220884:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c792334a000) 00010000:00010000:2.0:1789185637.220890:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c8d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.220902:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c8d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.220912:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c8d9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.220955:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185637.221044:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:2372:x1876096812415744:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 285us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185637.221061:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 83 00010000:00010000:1.0:1789185637.221225:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c8d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.221236:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c8d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185637.221768:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1789185637.221976:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1789185637.222026:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1789185637.222145:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f129c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876096821835136:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789185637.222227:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185637.222274:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7903519540 going to sleep for 11 seconds 00000100:00100000:3.0:1789185637.223350:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821835136 00000100:00100000:3.0:1789185637.223373:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821835136 00000100:00100000:3.0:1789185637.223501:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789185637.223514:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5822:x1876096821835136:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789185637.225586:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5822:x1876096821835136:12345-0@lo:1000:mdt00_000.0 Request processed in 2062us (3345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185637.225606:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185637.225621:0:5822:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1789185637.225630:0:5822:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1789185637.225660:0:5822:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7803235500, transno 4294967321 00000100:00100000:1.0:1789185637.225690:0:5822:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c7803235180 x1876096821834368/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789185653 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185637.225706:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f129c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876096821835136:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789185637.226867:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1789185637.226997:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f1ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876096821835264:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789185637.227090:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185637.227132:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906bef0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185637.227240:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821835264 00000100:00100000:0.0:1789185637.227252:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821835264 00000100:00100000:2.0:1789185637.227816:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789185637.227837:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5822:x1876096821835264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789185637.228492:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5822:x1876096821835264:12345-0@lo:1000:mdt00_000.0 Request processed in 660us (1398us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789185637.228502:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185637.228670:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f1ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876096821835264:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789185637.228729:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c8d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.228742:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c8d9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.228751:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c8d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.228759:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073ff000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185637.228765:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c8d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.228799:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c8d9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.228821:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c792334a000) 00010000:00010000:1.0:1789185637.228824:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789185637.228832:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c8d9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.228839:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ff000/0x532743011272c8d9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.228877:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c81c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.228883:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c81c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.228889:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c81c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.228893:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185637.228896:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c81c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.228902:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c81c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.228909:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:1.0:1789185637.228912:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789185637.228920:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c823 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d80e expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.228946:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c823 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d80e expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.228958:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c823 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d80e expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.229072:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c823 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d80e expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185637.229089:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821835392:192.168.202.54@tcp:105: 00000100:00100000:1.0:1789185637.229245:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906bef0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185637.236081:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876096821835392:192.168.202.54@tcp:105: 00000100:00100000:0.0:1789185637.236091:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:1.0:1789185637.236130:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c81c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236143:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4c800/0x532743011272c81c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236189:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c8e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236210:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c8e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236226:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c8e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236240:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c8e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236267:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c8e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236274:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c8e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236280:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4dc00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185637.236286:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c8e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236294:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c8e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236308:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:1.0:1789185637.236311:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185637.236316:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c8e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236322:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4dc00/0x532743011272c8e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236332:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c8d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236339:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c8d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236345:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c8d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236351:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185637.236360:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c8d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236366:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c8d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236375:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:1.0:1789185637.236377:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789185637.236381:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c8d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.236387:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354e00/0x532743011272c8d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185637.237008:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+23:11635:x1876096812415616:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 23957us (24203us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789185637.237023:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 229 00000020:00080000:1.0:1789185637.237032:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789185637.242324:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789185637.242340:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1789185637.242650:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812415872 00000100:00100000:3.0:1789185637.242667:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812415872 00000040:00080000:2.0:1789185637.243218:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789185637.243235:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789185637.243395:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:2.0:1789185637.243441:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+23:11634:x1876096812415872:12345-192.168.202.54@tcp:49:lfs.0 00000100:00100000:0.0:1789185637.243910:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185637.244016:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1789185637.244028:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1789185637.244509:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812416128 00000100:00100000:0.0:1789185637.244519:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812416128 00000100:00100000:3.0:1789185637.244818:0:12524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:3.0:1789185637.244829:0:12524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791916e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+24:11635:x1876096812416128:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789185637.245866:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+25:11634:x1876096812415872:12345-192.168.202.54@tcp:49:lfs.0 Request processed in 2453us (9773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185637.245888:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:0.0:1789185637.250688:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000004:00080000:2.0:1789185637.251842:0:12524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789185637.251963:0:12524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00000100:00100000:3.0:1789185637.252291:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812416384 00000100:00100000:3.0:1789185637.252304:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812416384 00010000:00010000:2.0:1789185637.252479:0:12524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c8e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.252502:0:12524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c8e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.252518:0:12524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c8e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.252537:0:12524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c8e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.252545:0:12524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c8e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.252553:0:12524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c8e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.252585:0:12524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185637.252755:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185637.252765:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c8e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.252775:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fe600 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185637.252781:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c8e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.252791:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c8e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.252809:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c792334ad00) 00010000:00010000:1.0:1789185637.252812:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789185637.252832:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c8e7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.252839:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe600/0x532743011272c8e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185637.252859:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185637.252861:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185637.252863:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185637.252986:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 230 00000100:00100000:0.0:1789185637.253005:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:11634:x1876096812416384:12345-192.168.202.54@tcp:58:lfs.0 00000040:00080000:0.0:1789185637.253277:0:11024:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789185637.253988:0:12524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791916e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:11635:x1876096812416128:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 9155us (10074us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789185637.254126:0:12524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 62 00000020:00080000:2.0:1789185637.254134:0:12524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789185637.254274:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+25:11634:x1876096812416384:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 1277us (3600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185637.254283:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 230 00000100:00100000:0.0:1789185637.301325:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185637.301525:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812416512 00000100:00100000:3.0:1789185637.301919:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812416512 00000100:00100000:3.0:1789185637.302237:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 231 00000100:00100000:3.0:1789185637.302253:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+25:11637:x1876096812416512:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185637.302287:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185637.302315:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c8ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d846 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.302402:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c8f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.302471:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c8f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.302485:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c8f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.302503:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c8fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.302541:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.302549:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.302961:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c903 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.302977:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d807 expref: 26 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.302986:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c903 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.303313:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d807 expref: 26 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185637.303337:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d807 expref: 26 pid: 5822 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185637.303354:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7803237b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876096821835520:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185637.303528:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78039a6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789185637.307989:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7803237b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876096821835520:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185637.308034:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c903 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185637.309352:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185637.309718:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812416768 00000100:00100000:3.0:1789185637.309731:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812416768 00000100:00100000:3.0:1789185637.309861:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:3.0:1789185637.309875:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+27:5612:x1876096812416768:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789185637.310232:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+28:5612:x1876096812416768:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 359us (890us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1789185637.310258:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:0.0:1789185637.317244:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185637.317390:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812416896 00000100:00100000:2.0:1789185637.317490:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812416896 00010000:00010000:2.0:1789185637.317614:0:6692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d807 expref: 28 pid: 5822 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185637.317731:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:2.0:1789185637.317745:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+28:2372:x1876096812416896:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185637.317766:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185637.317776:0:6692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d807 expref: 28 pid: 5822 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.317794:0:6692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d807 expref: 28 pid: 5822 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.317823:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272c80e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d807 expref: 28 pid: 5822 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.317844:0:6692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:2.0:1789185637.317851:0:6692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c903 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.317862:0:6692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.317871:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c903 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185637.317908:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185637.317984:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+27:2372:x1876096812416896:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 243us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185637.317992:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 84 00010000:00010000:0.0:1789185637.318090:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318100:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185637.318160:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789185637.318165:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185637.318192:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318209:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318221:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c8f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318228:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c8f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318235:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c8f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318242:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185637.318248:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c8f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318256:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c8f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318282:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:0.0:1789185637.318285:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185637.318290:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c8f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318296:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04c00/0x532743011272c8f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318310:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318317:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c8fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318322:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c8fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318328:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185637.318330:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c8fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318336:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c8fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318344:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c79055dd100) 00010000:00010000:0.0:1789185637.318346:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185637.318350:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c8fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318356:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272c8fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318464:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272c8ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d846 expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318482:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c903 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d846 expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185637.318490:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:0.0:1789185637.318493:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185637.318495:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04400, rc 0) 00000100:00100000:0.0:1789185637.318538:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:11637:x1876096812416512:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 16280us (17220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185637.318547:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 231 00010000:00010000:0.0:1789185637.519807:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185638.033016:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185638.033066:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185638.033097:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185638.033449:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812417024 00000100:00100000:1.0:1789185638.033462:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812417024 00000100:00100000:1.0:1789185638.033531:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 298 00000100:00100000:1.0:1789185638.033545:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812417024:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185638.033713:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812417024:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 171us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185638.033722:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 298 00000100:00100000:1.0:1789185638.033768:0:12523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812417152 00000100:00100000:1.0:1789185638.033772:0:12523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812417152 00000100:00100000:1.0:1789185638.033817:0:12523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:1.0:1789185638.033824:0:12523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2370:x1876096812417152:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185638.033853:0:12523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2370:x1876096812417152:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 30us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185638.033859:0:12523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00080000:0.0:1789185638.035510:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185638.035537:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812417280 00000100:00100000:0.0:1789185638.035546:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812417280 00000100:00100000:0.0:1789185638.035613:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00100000:0.0:1789185638.035623:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812417280:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185638.035768:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812417280:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 146us (2668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185638.035776:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00080000:0.0:1789185638.035801:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789185638.288684:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789185638.288706:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789185638.288756:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789185638.288763:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789185638.288932:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc80380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1876096821835648:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789185638.289383:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c792f6a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1789185638.298031:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185638.298198:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc80380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1876096821835648:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789185638.298481:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812417408 00000100:00100000:1.0:1789185638.298491:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812417408 00000100:00100000:1.0:1789185638.298549:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 232 00000100:00100000:1.0:1789185638.298561:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:11648:x1876096812417408:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789185638.298635:0:5822:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789185638.298765:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:11648:x1876096812417408:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 205us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185638.298774:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 232 00000100:00100000:0.0:1789185638.316846:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185638.316952:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812417664 00000100:00100000:2.0:1789185638.316966:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812417664 00000100:00100000:2.0:1789185638.317108:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 233 00000100:00100000:2.0:1789185638.317123:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+26:11648:x1876096812417664:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185638.317154:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185638.317184:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c90a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d84d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185638.331947:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c911 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185638.331982:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185638.332003:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185638.332019:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789185638.332226:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffe00/0x532743011272c90a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d84d expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185638.332249:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c911 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d84d expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185638.332259:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:0.0:1789185638.332263:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185638.332267:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355e00, rc 0) 00000100:00100000:0.0:1789185638.332369:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+28:11648:x1876096812417664:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 15249us (15534us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789185638.332380:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 233 00000100:00100000:2.0:1789185638.349489:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185638.349613:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185638.349652:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812418048 00000100:00100000:2.0:1789185638.349665:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812418048 00000100:00100000:2.0:1789185638.349747:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:3.0:1789185638.349756:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812417920 00000100:00100000:3.0:1789185638.349761:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812417920 00000100:00100000:2.0:1789185638.349761:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+28:2371:x1876096812418048:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185638.349780:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789185638.349792:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 234 00000100:00100000:3.0:1789185638.349800:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+29:11648:x1876096812417920:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789185638.349812:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c911 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d84d expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185638.349835:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:2.0:1789185638.349841:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185638.349887:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c91f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185638.349904:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c91f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185638.349918:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c91f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185638.349929:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+28:2371:x1876096812418048:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 171us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185638.349937:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00010000:00010000:3.0:1789185638.350161:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c91f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185638.350170:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c91f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185638.350178:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c91f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185638.350184:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185638.350190:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c91f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185638.350200:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c91f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185638.350234:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:3.0:1789185638.350236:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789185638.350241:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c91f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185638.350248:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05200/0x532743011272c91f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185638.350466:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+28:11648:x1876096812417920:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 666us (993us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789185638.350475:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 234 00000040:00080000:2.0:1789185638.351262:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789185638.351269:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789185638.353527:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789185638.353549:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789185638.359191:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185638.359711:0:12524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812418304 00000100:00100000:0.0:1789185638.359724:0:12524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812418304 00000100:00100000:0.0:1789185638.359813:0:12524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:0.0:1789185638.359827:0:12524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+28:11648:x1876096812418304:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789185638.360190:0:12524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+29:11648:x1876096812418304:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 366us (1013us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789185638.360216:0:12524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 64 00000040:00080000:2.0:1789185638.431478:0:12562:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789185638.431493:0:12562:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789185638.431551:0:12562:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789185638.431558:0:12562:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789185638.545604:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185638.675541:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185638.677568:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812418560 00000100:00100000:0.0:1789185638.677588:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812418560 00000100:00100000:0.0:1789185638.677672:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 235 00000100:00100000:0.0:1789185638.677686:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+29:11661:x1876096812418560:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789185638.677719:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185638.677745:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c926 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d854 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185638.677867:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c92d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185638.677883:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c92d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185638.677896:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c92d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185638.677908:0:11024:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789185638.678052:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c926 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d854 expref: 32 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185638.678071:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c92d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d854 expref: 31 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185638.678080:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:0.0:1789185638.678083:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789185638.678104:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354000, rc 0) 00000100:00100000:0.0:1789185638.678191:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+31:11661:x1876096812418560:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 508us (2662us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789185638.678198:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 235 00000100:00100000:2.0:1789185638.684464:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185638.684537:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812418688 00000100:00100000:2.0:1789185638.684550:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812418688 00000100:00100000:2.0:1789185638.684633:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 236 00000100:00100000:2.0:1789185638.684646:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+31:11661:x1876096812418688:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:2.0:1789185638.684742:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c93b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185638.684764:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c93b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185638.684779:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c93b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185638.684813:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c93b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185638.684843:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c93b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185638.684851:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c93b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185638.684858:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073ffc00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185638.684863:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c93b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185638.684873:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c93b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185638.684888:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:2.0:1789185638.684892:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185638.684898:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c93b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185638.684905:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffc00/0x532743011272c93b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185638.684995:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+31:11661:x1876096812418688:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 350us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185638.685003:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 236 00000100:00100000:3.0:1789185638.771094:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185638.771185:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812418816 00000100:00100000:1.0:1789185638.771198:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812418816 00000100:00100000:1.0:1789185638.771274:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:1.0:1789185638.771282:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2372:x1876096812418816:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:1.0:1789185638.771304:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185638.771326:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d5f6106/0x532743011272c942 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d85b expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789185638.771355:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa4ce63, atime: 0x6aa4ce63, ctime: 0x6aa4ce63, blocks: 0xb 00010000:00010000:1.0:1789185638.771383:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=335s v=(0 0) 00010000:00010000:1.0:1789185638.771388:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185638.771449:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d5f6106/0x532743011272c942 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d85b expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185638.771469:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d5f6106/0x532743011272c942 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d85b expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185638.771484:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4d800, rc 0) 00000100:00100000:1.0:1789185638.771556:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2372:x1876096812418816:12345-192.168.202.54@tcp:101:cat.0 Request processed in 275us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185638.771564:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00080000:0.0:1789185638.771903:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185638.774160:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185638.774285:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812418944 00000100:00100000:0.0:1789185638.774298:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812418944 00002000:00100000:0.0:1789185638.774352:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9c793fc80a80 x1876096812418944/t0(0) o3->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:239/0 lens 488/0 e 0 to 0 dl 1789185649 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789185638.774364:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c793fc80a80 with x1876096812418944 ext(0->4095) 00002000:00010000:0.0:1789185638.774371:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c793fc80a80 00000100:00100000:0.0:1789185638.774493:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1789185638.774503:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2369:x1876096812418944:12345-192.168.202.54@tcp:3:cat.0 00000100:00100000:0.0:1789185638.774765:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+8:2369:x1876096812418944:12345-192.168.202.54@tcp:3:cat.0 Request processed in 263us (617us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789185638.774772:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00002000:00100000:0.0:1789185638.774778:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9c793fc80a80 x1876096812418944/t0(0) o3->19bfb1a3-97ed-41fd-ac10-946cffd5be7d@192.168.202.54@tcp:239/0 lens 488/4536 e 0 to 0 dl 1789185649 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789185638.774784:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c793fc80a80 with x1876096812418944 ext(0->4095) 00002000:00010000:0.0:1789185638.774787:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c793fc80a80 00000100:00100000:3.0:1789185639.314675:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821836160:0@lo:400:kworker.0 00000100:00100000:3.0:1789185639.314778:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185639.314883:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789185639.314890:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821835776:0@lo:400:kworker.0 00000100:00100000:3.0:1789185639.314927:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185639.314952:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821836288:0@lo:400:kworker.0 00000100:00100000:3.0:1789185639.314981:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185639.315013:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821835904:0@lo:400:kworker.0 00000100:00100000:3.0:1789185639.315037:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185639.315068:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821836416:0@lo:400:kworker.0 00000100:00100000:3.0:1789185639.315094:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185639.315119:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821836032:0@lo:400:kworker.0 00000100:00100000:2.0:1789185639.315157:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185639.315256:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821836288 00000100:00100000:0.0:1789185639.315257:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821836160 00000100:00100000:3.0:1789185639.315268:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821836288 00000100:00100000:0.0:1789185639.315268:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821836160 00000100:00100000:3.0:1789185639.315344:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821835904 00000100:00100000:3.0:1789185639.315366:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821835904 00000100:00100000:3.0:1789185639.315383:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821836032 00000100:00100000:3.0:1789185639.315385:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821836032 00000100:00100000:1.0:1789185639.315475:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821835776 00000100:00100000:1.0:1789185639.315480:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821835776 00000100:00100000:1.0:1789185639.315516:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789185639.315523:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821835776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185639.315579:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821835776:12345-0@lo:400:kworker.0 Request processed in 57us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185639.315584:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789185639.315617:0:12523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821836416 00000100:00100000:1.0:1789185639.315620:0:12523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821836416 00000100:00100000:0.0:1789185639.319737:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789185639.319763:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3278:x1876096821836160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185639.319890:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3278:x1876096821836160:12345-0@lo:400:kworker.0 Request processed in 138us (5113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185639.319918:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789185639.319968:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789185639.319978:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821836288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185639.320015:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821836288:12345-0@lo:400:kworker.0 Request processed in 40us (5034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185639.320021:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789185639.320039:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789185639.320046:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821835904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185639.322567:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821835904:12345-0@lo:400:kworker.0 Request processed in 2508us (7515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185639.322586:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789185639.322727:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821836544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185639.322783:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185639.322901:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821835904:0@lo:400:kworker.0 00000100:00100000:0.0:1789185639.322966:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821835776:0@lo:400:kworker.0 00000100:00100000:0.0:1789185639.322982:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821836288:0@lo:400:kworker.0 00000100:00100000:0.0:1789185639.323002:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821836160:0@lo:400:kworker.0 00000100:00100000:0.0:1789185639.323236:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821836544 00000100:00100000:0.0:1789185639.323245:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821836544 00000100:00100000:0.0:1789185639.323299:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789185639.323310:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3281:x1876096821836544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185639.323364:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789185639.323473:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3281:x1876096821836544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185639.323498:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789185639.323543:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821836544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185639.326234:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789185639.326254:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821836032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185639.326432:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821836032:12345-0@lo:400:kworker.0 Request processed in 183us (11273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185639.326441:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789185639.326683:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821836032:0@lo:400:kworker.0 00000100:00100000:1.0:1789185639.332157:0:12523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789185639.332180:0:12523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3280:x1876096821836416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185639.332319:0:12523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3280:x1876096821836416:12345-0@lo:400:kworker.0 Request processed in 148us (17224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185639.332326:0:12523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789185639.333793:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821836416:0@lo:400:kworker.0 00000100:00080000:2.0:1789185639.338003:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185639.338072:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789185639.338104:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789185639.567633:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789185639.867251:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1789185639.867274:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1789185640.336871:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185640.336905:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7803234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821836672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185640.337009:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185640.337126:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821836672 00000100:00100000:3.0:1789185640.337137:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821836672 00000100:00100000:3.0:1789185640.337205:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789185640.337216:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821836672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185640.337259:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185640.337311:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821836672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185640.337319:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789185640.337472:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789185640.337481:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1789185640.337508:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c793fc3d880, transno 4294967310 00000100:00100000:2.0:1789185640.337530:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7803234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821836672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789185640.592310:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185641.617498:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789185642.473070:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1789185642.473098:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1789185642.473105:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1789185642.498047:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1789185642.498078:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1789185642.498110:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c7906befd80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789185642.498117:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7941031100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c7906befcc0 00000020:00080000:0.0:1789185642.498121:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7941031300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c7907cc2800 00000020:00080000:1.0:1789185642.498267:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789185642.498611:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1789185642.639649:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185643.147491:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185643.147516:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185643.147532:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185643.147553:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185643.147577:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185643.147712:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812419072 00000100:00100000:2.0:1789185643.147720:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812419072 00000100:00100000:2.0:1789185643.147761:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 300 00000100:00100000:2.0:1789185643.147767:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2369:x1876096812419072:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185643.147821:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2369:x1876096812419072:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 54us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185643.147826:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 300 00000100:00100000:2.0:1789185643.147852:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812419328 00000100:00100000:2.0:1789185643.147854:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812419328 00000100:00100000:2.0:1789185643.147878:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812419456 00000100:00100000:2.0:1789185643.147879:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812419456 00000100:00100000:2.0:1789185643.147900:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:2.0:1789185643.147910:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78026a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812419328:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185643.147931:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78026a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2369:x1876096812419328:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 22us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185643.147935:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:2.0:1789185643.147943:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:2.0:1789185643.147946:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2369:x1876096812419456:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185643.147959:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2369:x1876096812419456:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 13us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185643.147963:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:2.0:1789185643.147975:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812419584 00000100:00100000:2.0:1789185643.147977:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812419584 00000100:00100000:2.0:1789185643.147999:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812419200 00000100:00100000:2.0:1789185643.148002:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812419200 00000100:00100000:2.0:1789185643.148030:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 165 00000100:00100000:2.0:1789185643.148037:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812419584:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185643.148065:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2369:x1876096812419584:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 29us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185643.148071:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 165 00000100:00100000:2.0:1789185643.148083:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 166 00000100:00100000:2.0:1789185643.148090:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+18:2369:x1876096812419200:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185643.148114:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+18:2369:x1876096812419200:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 26us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185643.148121:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 166 00000100:00080000:2.0:1789185643.148258:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789185643.148268:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185643.148270:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789185643.664134:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185643.786597:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185643.786777:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812419712 00000100:00100000:0.0:1789185643.786788:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812419712 00000100:00100000:0.0:1789185643.786850:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 237 00000100:00100000:0.0:1789185643.786861:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+18:11322:x1876096812419712:12345-192.168.202.54@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789185643.786969:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+18:11322:x1876096812419712:12345-192.168.202.54@tcp:60:lhsmtool_posix.0 Request processed in 110us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185643.786976:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 237 00000100:00100000:2.0:1789185643.811634:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185643.811971:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812419968 00000100:00100000:3.0:1789185643.811982:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812419968 00000100:00100000:3.0:1789185643.812039:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:3.0:1789185643.812051:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+18:11322:x1876096812419968:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789185643.812606:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:11322:x1876096812419968:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 554us (979us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789185643.812615:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:1.0:1789185644.432396:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185644.432448:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7908339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821837184:0@lo:400:kworker.0 00000100:00100000:0.0:1789185644.432481:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821837312:0@lo:400:kworker.0 00000100:00100000:3.0:1789185644.432574:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821836928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185644.445822:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185644.445935:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821837056:0@lo:400:kworker.0 00000100:00100000:0.0:1789185644.446008:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185644.446038:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821837568:0@lo:400:kworker.0 00000100:00100000:0.0:1789185644.446062:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185644.446124:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821837056 00000100:00100000:0.0:1789185644.446132:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821837056 00000100:00100000:0.0:1789185644.446178:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789185644.446188:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821837056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185644.446242:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821837056:12345-0@lo:400:kworker.0 Request processed in 56us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185644.446249:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789185644.446274:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821837312 00000100:00100000:0.0:1789185644.446278:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821837312 00000100:00100000:0.0:1789185644.446314:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821837568 00000100:00100000:0.0:1789185644.446318:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821837568 00000100:00100000:0.0:1789185644.446340:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789185644.446358:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821837312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185644.446396:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821837312:12345-0@lo:400:kworker.0 Request processed in 50us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185644.446424:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789185644.446438:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789185644.446444:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821837568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185644.446473:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821837568:12345-0@lo:400:kworker.0 Request processed in 30us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185644.446479:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789185644.446500:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185644.446504:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185644.446538:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821837056:0@lo:400:kworker.0 00000100:00100000:0.0:1789185644.446547:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1789185644.446552:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7803235180, transno 4294967322 00000004:00080000:0.0:1789185644.446563:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1789185644.446600:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821837568:0@lo:400:kworker.0 00000100:00100000:0.0:1789185644.446933:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821837312:0@lo:400:kworker.0 00000100:00100000:1.0:1789185644.449374:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185644.449651:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7903422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821836800:0@lo:400:kworker.0 00000100:00100000:1.0:1789185644.449715:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185644.450208:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821836800 00000100:00100000:2.0:1789185644.450219:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821836800 00000100:00100000:2.0:1789185644.450281:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789185644.450291:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821836800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185644.450366:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3278:x1876096821836800:12345-0@lo:400:kworker.0 Request processed in 75us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185644.450373:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789185644.450393:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7903422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821836800:0@lo:400:kworker.0 00000100:00100000:0.0:1789185644.453267:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821837184 00000100:00100000:0.0:1789185644.453282:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821837184 00000100:00100000:0.0:1789185644.453392:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789185644.453439:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821837184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185644.453547:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821837184:12345-0@lo:400:kworker.0 Request processed in 146us (4179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185644.453554:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1789185644.453633:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185644.453768:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7908339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821837184:0@lo:400:kworker.0 00000100:00100000:2.0:1789185644.456588:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185644.456640:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821837440:0@lo:400:kworker.0 00000100:00100000:2.0:1789185644.456686:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185644.456825:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821837440 00000100:00100000:3.0:1789185644.456835:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821837440 00000100:00100000:3.0:1789185644.456907:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789185644.456917:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821837440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185644.457139:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821836928 00000100:00100000:0.0:1789185644.457144:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821836928 00000100:00100000:0.0:1789185644.457178:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789185644.457184:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821836928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185644.457212:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789185644.457277:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185644.457561:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821837440:12345-0@lo:400:kworker.0 Request processed in 644us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185644.457570:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789185644.458311:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821836928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1124us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185644.458319:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789185644.460249:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821837440:0@lo:400:kworker.0 00000100:00100000:2.0:1789185644.460497:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821836928:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789185644.497340:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789185644.497360:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789185644.497403:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789185644.497445:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789185644.689172:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185645.457674:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185645.457702:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7803237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821837696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185645.457772:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185645.457834:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821837696 00000100:00100000:3.0:1789185645.457841:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821837696 00000100:00100000:3.0:1789185645.457884:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789185645.457893:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821837696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185645.457926:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185645.457971:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821837696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185645.457978:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789185645.458025:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7803237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821837696:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789185645.727688:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789185645.761935:0:12765:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 00:00:43 (1789185643) 00010000:00010000:3.0:1789185646.739076:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789185647.612092:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1789185647.612133:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1789185647.615196:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789185647.615214:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1789185647.766254:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185648.265188:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185648.265237:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185648.265268:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185648.265291:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185648.265326:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185648.265351:0:12523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812420352 00000100:00100000:0.0:1789185648.265360:0:12523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812420352 00000100:00100000:0.0:1789185648.265433:0:12523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812420480 00000100:00100000:0.0:1789185648.265447:0:12523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812420480 00000100:00100000:0.0:1789185648.265477:0:12523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:0.0:1789185648.265487:0:12523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812420352:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185648.265562:0:12523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2370:x1876096812420352:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 76us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185648.265570:0:12523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:0.0:1789185648.265588:0:12523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:0.0:1789185648.265595:0:12523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2370:x1876096812420480:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185648.265622:0:12523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2370:x1876096812420480:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 28us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185648.265903:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812420096 00000100:00100000:1.0:1789185648.265908:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812420096 00000100:00100000:1.0:1789185648.265940:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 302 00000100:00100000:1.0:1789185648.265960:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812420096:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185648.265996:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812420096:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 37us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185648.266003:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 302 00000100:00100000:0.0:1789185648.266201:0:12523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:0.0:1789185648.266222:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812420608 00000100:00100000:0.0:1789185648.266226:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812420608 00000100:00100000:0.0:1789185648.266259:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812420224 00000100:00100000:0.0:1789185648.266263:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812420224 00000100:00100000:0.0:1789185648.266287:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 170 00000100:00100000:0.0:1789185648.266294:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812420608:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185648.266335:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:2370:x1876096812420608:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 40us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185648.266342:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 170 00000100:00100000:0.0:1789185648.266354:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:0.0:1789185648.266361:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+18:2370:x1876096812420224:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185648.266392:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+18:2370:x1876096812420224:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 31us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185648.266398:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00080000:0.0:1789185648.266452:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185648.266456:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185648.266459:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185648.441635:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185648.441764:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812420736 00000100:00100000:0.0:1789185648.441775:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812420736 00000100:00100000:0.0:1789185648.441845:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 238 00000100:00100000:0.0:1789185648.441855:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+5:12326:x1876096812420736:12345-192.168.202.54@tcp:101:lsof.0 00010000:00010000:0.0:1789185648.441876:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185648.441897:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c949 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d862 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185648.441972:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c950 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185648.441990:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185648.442001:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185648.442033:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789185648.442035:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185648.442066:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185648.442085:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272c949 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d862 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185648.442098:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c950 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d862 expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185648.442120:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334a200) 00010000:00010000:0.0:1789185648.442122:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185648.442125:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355e00, rc 0) 00000100:00100000:0.0:1789185648.442179:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c8f5f6e-29cb-49a9-885e-2459dbca0795+6:12326:x1876096812420736:12345-192.168.202.54@tcp:101:lsof.0 Request processed in 327us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185648.442185:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 238 00010000:00010000:1.0:1789185648.783938:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185649.551663:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821837824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185649.551701:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821838080:0@lo:400:kworker.0 00000100:00100000:3.0:1789185649.551738:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185649.551738:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185649.551775:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821838336:0@lo:400:kworker.0 00000100:00100000:0.0:1789185649.551795:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185649.551811:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821838208:0@lo:400:kworker.0 00000100:00100000:1.0:1789185649.551822:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185649.551836:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185649.551864:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821838336 00000100:00100000:1.0:1789185649.551876:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821838336 00000100:00100000:1.0:1789185649.551949:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789185649.551959:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7908339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821838336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185649.552010:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7908339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821838336:12345-0@lo:400:kworker.0 Request processed in 53us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185649.552017:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1789185649.552038:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185649.552066:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821838080 00000100:00100000:1.0:1789185649.552070:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821838080 00000100:00100000:1.0:1789185649.552094:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821838208 00000100:00100000:1.0:1789185649.552097:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821838208 00000100:00100000:1.0:1789185649.552121:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789185649.552127:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821838080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185649.552841:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821837952:0@lo:400:kworker.0 00000100:00100000:3.0:1789185649.552878:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185649.556012:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789185649.556038:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821838208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185649.556461:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821837952 00000100:00100000:2.0:1789185649.556470:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821837952 00000100:00100000:2.0:1789185649.556529:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789185649.556551:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3279:x1876096821837952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185649.556599:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3279:x1876096821837952:12345-0@lo:400:kworker.0 Request processed in 49us (3720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185649.556606:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:2.0:1789185649.556654:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185649.556693:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821838336:0@lo:400:kworker.0 00000100:00100000:2.0:1789185649.556713:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789185649.556724:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821838464:0@lo:400:kworker.0 00000100:00100000:2.0:1789185649.556758:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185649.556787:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789185649.556796:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789185649.556860:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821838080:12345-0@lo:400:kworker.0 Request processed in 4729us (5118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185649.556876:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789185649.556912:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821838464 00000100:00100000:1.0:1789185649.556917:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821838464 00000100:00100000:1.0:1789185649.556953:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789185649.556960:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821838464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185649.557021:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821838464:12345-0@lo:400:kworker.0 Request processed in 61us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185649.557027:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:1.0:1789185649.557043:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185649.557073:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821838464:0@lo:400:kworker.0 00000100:00100000:2.0:1789185649.557192:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821837824 00000100:00100000:2.0:1789185649.557197:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821837824 00000100:00100000:2.0:1789185649.557238:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789185649.557245:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821837824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789185649.557274:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185649.557320:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821837824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (5582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185649.557327:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1789185649.557351:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185649.557661:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821837824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185649.557673:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821837952:0@lo:400:kworker.0 00000100:00100000:1.0:1789185649.560667:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821838208:0@lo:400:kworker.0 00000100:00100000:0.0:1789185649.560667:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821838208:12345-0@lo:400:kworker.0 Request processed in 4632us (8819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185649.560686:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789185649.560689:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821838080:0@lo:400:kworker.0 00010000:00010000:3.0:1789185649.807598:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185650.575629:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7803234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821838592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185650.575706:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185650.575841:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821838592 00000100:00100000:2.0:1789185650.575851:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821838592 00000100:00100000:2.0:1789185650.575899:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789185650.575908:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821838592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185650.575950:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185650.583402:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821838592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7484us (7684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185650.583431:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789185650.584580:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7803234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821838592:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789185650.831683:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185650.956944:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185650.960101:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812420992 00000100:00100000:3.0:1789185650.960117:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812420992 00000100:00100000:3.0:1789185650.960215:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:3.0:1789185650.960229:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+18:12328:x1876096812420992:12345-192.168.202.54@tcp:35:umount.0 00000100:00100000:3.0:1789185650.960668:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:12328:x1876096812420992:12345-192.168.202.54@tcp:35:umount.0 Request processed in 441us (3731us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789185650.960676:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00080000:1.0:1789185650.960772:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185650.975520:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185650.976159:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812421248 00000100:00100000:2.0:1789185650.976172:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812421248 00000100:00100000:2.0:1789185650.976229:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:2.0:1789185650.976240:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+19:12328:x1876096812421248:12345-192.168.202.54@tcp:35:umount.0 00000100:00100000:2.0:1789185650.976638:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:12328:x1876096812421248:12345-192.168.202.54@tcp:35:umount.0 Request processed in 399us (1128us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1789185650.976646:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:2.0:1789185650.982476:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185650.982671:0:12524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812421504 00000100:00100000:0.0:1789185650.982683:0:12524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812421504 00000100:00100000:0.0:1789185650.982745:0:12524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:0.0:1789185650.982756:0:12524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c791916dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+20:12328:x1876096812421504:12345-192.168.202.54@tcp:35:umount.0 00000100:00100000:0.0:1789185650.983030:0:12524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c791916dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:12328:x1876096812421504:12345-192.168.202.54@tcp:35:umount.0 Request processed in 274us (564us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789185650.983039:0:12524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:0.0:1789185650.988176:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185650.988511:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812421760 00000100:00100000:2.0:1789185650.988521:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812421760 00000100:00100000:2.0:1789185650.988572:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:2.0:1789185650.988581:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:12328:x1876096812421760:12345-192.168.202.54@tcp:35:umount.0 00000100:00100000:2.0:1789185650.988901:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+22:12328:x1876096812421760:12345-192.168.202.54@tcp:35:umount.0 Request processed in 320us (736us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1789185650.988908:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:1.0:1789185650.999207:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185650.999309:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185650.999421:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185650.999521:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812422400 00000100:00100000:2.0:1789185650.999535:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812422400 00000100:00100000:2.0:1789185650.999833:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812422272 00000100:00100000:2.0:1789185650.999838:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812422272 00000100:00100000:2.0:1789185650.999869:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:2.0:1789185650.999881:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5241da3d-acea-4d5e-9360-a7cef404ad9c+14:2370:x1876096812422400:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185650.999900:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185650.999936:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c793fe05800/0x532743011272b93c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3bc expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185651.000140:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185651.000229:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5241da3d-acea-4d5e-9360-a7cef404ad9c+13:2370:x1876096812422400:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 350us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185651.000238:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:2.0:1789185651.000260:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:2.0:1789185651.000267:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793081e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:2370:x1876096812422272:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185651.000275:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185651.000299:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d6c00/0x532743011272b9d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3f4 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185651.000310:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185651.000331:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793081e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:2370:x1876096812422272:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 65us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185651.000338:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:1.0:1789185651.002543:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185651.002855:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812422528 00000100:00100000:2.0:1789185651.002867:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812422528 00000100:00100000:2.0:1789185651.002962:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:2.0:1789185651.002977:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903420000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:2370:x1876096812422528:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185651.003001:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185651.003025:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7907355c00/0x532743011272bbc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4bf expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185651.003047:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185651.003256:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903420000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2370:x1876096812422528:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 283us (3849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185651.003265:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:0.0:1789185651.008118:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812422144 00000100:00100000:0.0:1789185651.008138:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812422144 00000100:00100000:0.0:1789185651.008239:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:0.0:1789185651.008256:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7903422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+7:2368:x1876096812422144:12345-192.168.202.54@tcp:9:umount.0 00000020:00000080:0.0:1789185651.008316:0:6676:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272bf16 00000020:00010000:0.0:1789185651.008327:0:6676:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c792fe6b000: total 0 00000100:00080000:0.0:1789185651.008335:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9c792fe6c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789185651.008393:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789185651.008812:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7903422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2368:x1876096812422144:12345-192.168.202.54@tcp:9:umount.0 Request processed in 557us (6279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185651.008822:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 72 00000020:00010000:0.0:1789185651.009308:0:5812:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c792fe6b000: total 0 00010000:00010000:0.0:1789185651.009339:0:5812:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c792fe6b000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789185651.009459:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000525deea4/0x532743011272c2b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d694 expref: 4 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185651.009504:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d5f6106/0x532743011272c942 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d85b expref: 3 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185651.009522:0:5812:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c792fe6b000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789185651.009535:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185651.009537:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185651.009539:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789185651.013546:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185651.014587:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185651.014808:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812422656 00000100:00100000:0.0:1789185651.014822:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812422656 00000100:00100000:0.0:1789185651.014913:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:0.0:1789185651.014934:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+5:2368:x1876096812422656:12345-192.168.202.54@tcp:9:umount.0 00000020:00000080:0.0:1789185651.014993:0:6679:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272bcae 00000100:00080000:0.0:1789185651.015005:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9c791a5a7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789185651.015274:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789185651.015700:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+2:2368:x1876096812422656:12345-192.168.202.54@tcp:9:umount.0 Request processed in 765us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185651.015711:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00080000:2.0:1789185651.016524:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789185651.018453:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185651.031161:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185651.031311:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812423680 00000100:00100000:1.0:1789185651.031327:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812423680 00000100:00100000:1.0:1789185651.031470:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 239 00000100:00100000:1.0:1789185651.031484:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+22:2368:x1876096812423680:12345-192.168.202.54@tcp:39:umount.0 00000020:00000080:1.0:1789185651.031568:0:11024:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b94a 00000020:00010000:1.0:1789185651.031591:0:11024:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c78011b5800: total 0 00000100:00080000:1.0:1789185651.031598:0:11024:0:(import.c:65:import_set_state_nolock()) ffff9c78011b0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789185651.031630:0:11024:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1789185651.032500:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19bfb1a3-97ed-41fd-ac10-946cffd5be7d+21:2368:x1876096812423680:12345-192.168.202.54@tcp:39:umount.0 Request processed in 1012us (1577us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1789185651.032511:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 239 00000020:00010000:0.0:1789185651.033397:0:11163:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c78011b5800: total 0 00010000:00010000:0.0:1789185651.033504:0:11163:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c78011b5800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789185651.033550:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:0.0:1789185651.033555:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789185651.033576:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355200/0x532743011272c193 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d647 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185651.033600:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:0.0:1789185651.033602:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185651.033606:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04400/0x532743011272c903 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d846 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185651.033620:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:0.0:1789185651.033623:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789185651.033626:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04a00/0x532743011272bc84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4e9 expref: 18 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185651.033636:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334a200) 00010000:00010000:0.0:1789185651.033639:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185651.033641:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7000/0x532743011272c306 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6a9 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185651.033681:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:0.0:1789185651.033684:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789185651.033688:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272c92d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d854 expref: 16 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185651.033702:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c792334af00) 00010000:00010000:0.0:1789185651.033704:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185651.033708:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272bc30 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4d4 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185651.033728:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:0.0:1789185651.033730:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789185651.033733:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073fe200/0x532743011272c601 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d782 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185651.033744:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c792334a100) 00010000:00010000:0.0:1789185651.033746:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789185651.033750:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79073ffa00/0x532743011272c322 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d6b0 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185651.033765:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:0.0:1789185651.033768:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185651.033771:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272c273 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d67f expref: 12 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185651.033785:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c791aedce00) 00010000:00010000:0.0:1789185651.033788:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789185651.033799:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272c823 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d80e expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185651.033819:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c79055ddd00) 00010000:00010000:0.0:1789185651.033821:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789185651.033824:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05c00/0x532743011272bf71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d5bb expref: 10 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185651.033851:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c791aedc500) 00010000:00010000:0.0:1789185651.033854:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185651.033858:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4cc00/0x532743011272bc14 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4cd expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185651.033874:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c792334a300) 00010000:00010000:0.0:1789185651.033877:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789185651.033881:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4de00/0x532743011272c29d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d68d expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185651.033896:0:11163:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c78011b5800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789185651.033909:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185651.033912:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185651.033914:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185651.857677:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789185652.741535:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000020:00000080:2.0:1789185652.741549:0:7633:0:(genops.c:885:class_export_put()) final put ffff9c792fe6b000/19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000020:00000080:2.0:1789185652.741600:0:486:0:(genops.c:844:class_export_destroy()) destroying export ffff9c792fe6b000/19bfb1a3-97ed-41fd-ac10-946cffd5be7d for lustre-OST0001 00000020:00000080:2.0:1789185652.741670:0:486:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c792fe6c800 for lustre-OST0001 00000001:00080000:1.0:1789185652.755134:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:1.0:1789185652.755175:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000001:00080000:1.0:1789185652.755192:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789185652.755229:0:5844:0:(genops.c:885:class_export_put()) final put ffff9c78011b5800/19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000020:00000080:3.0:1789185652.757381:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c78011b5800/19bfb1a3-97ed-41fd-ac10-946cffd5be7d for lustre-MDT0000 00000020:00000080:3.0:1789185652.757506:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c78011b0000 for lustre-MDT0000 00010000:00010000:3.0:1789185652.881888:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185653.383814:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185653.383941:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812423808 00000100:00100000:1.0:1789185653.383952:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812423808 00000100:00100000:1.0:1789185653.384014:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 304 00000100:00100000:1.0:1789185653.384026:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2370:x1876096812423808:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185653.384129:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2370:x1876096812423808:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 105us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185653.384136:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 304 00000100:00100000:0.0:1789185653.385598:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185653.385691:0:12880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812423936 00000100:00100000:2.0:1789185653.385698:0:12880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812423936 00000100:00100000:2.0:1789185653.385768:0:12880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 175 00000100:00100000:2.0:1789185653.385789:0:12880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c8f5f6e-29cb-49a9-885e-2459dbca0795+6:2369:x1876096812423936:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185653.385854:0:12880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c8f5f6e-29cb-49a9-885e-2459dbca0795+6:2369:x1876096812423936:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 67us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185653.385860:0:12880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 175 00000100:00080000:1.0:1789185653.386045:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185653.848179:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185653.848224:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185653.848301:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185653.848478:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812424064 00000100:00100000:1.0:1789185653.848488:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812424064 00000100:00100000:1.0:1789185653.848565:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812424320 00000100:00100000:1.0:1789185653.848569:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812424320 00000100:00100000:1.0:1789185653.848585:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812424192 00000100:00100000:1.0:1789185653.848588:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812424192 00000100:00100000:1.0:1789185653.848605:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:1.0:1789185653.848615:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5241da3d-acea-4d5e-9360-a7cef404ad9c+12:2371:x1876096812424064:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185653.848651:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185653.848672:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d6e00/0x532743011272ba1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d409 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185653.848691:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185653.848743:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5241da3d-acea-4d5e-9360-a7cef404ad9c+11:2371:x1876096812424064:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 131us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185653.848751:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:1.0:1789185653.848769:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:1.0:1789185653.848775:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5241da3d-acea-4d5e-9360-a7cef404ad9c+10:2371:x1876096812424320:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185653.848783:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185653.848791:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7907354c00/0x532743011272bbb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d4b8 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185653.848799:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185653.848815:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5241da3d-acea-4d5e-9360-a7cef404ad9c+9:2371:x1876096812424320:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 41us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185653.848835:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:1.0:1789185653.848847:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1789185653.848853:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5241da3d-acea-4d5e-9360-a7cef404ad9c+8:2371:x1876096812424192:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185653.848862:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185653.848870:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7907354800/0x532743011272ba23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d433 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185653.848878:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185653.848904:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5241da3d-acea-4d5e-9360-a7cef404ad9c+7:2371:x1876096812424192:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 51us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185653.848917:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:0.0:1789185653.861686:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185653.861794:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812424576 00000100:00100000:2.0:1789185653.861806:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812424576 00000100:00100000:2.0:1789185653.861879:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 240 00000100:00100000:2.0:1789185653.861899:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+6:2368:x1876096812424576:12345-192.168.202.54@tcp:39:umount.0 00000020:00000080:2.0:1789185653.861944:0:5822:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272ba31 00000020:00010000:2.0:1789185653.861955:0:5822:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c792fb09800: total 0 00000100:00080000:2.0:1789185653.861961:0:5822:0:(import.c:65:import_set_state_nolock()) ffff9c792fb0b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789185653.861994:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:3.0:1789185653.862252:0:11163:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c792fb09800: total 0 00010000:00010000:3.0:1789185653.862267:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185653.862308:0:11163:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c792fb09800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789185653.862342:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c792334a200) 00010000:00010000:3.0:1789185653.862346:0:11163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789185653.862355:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355e00/0x532743011272c950 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d862 expref: 5 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185653.862380:0:11163:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c792fb09800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789185653.862390:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185653.862392:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185653.862393:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185653.863042:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c8f5f6e-29cb-49a9-885e-2459dbca0795+3:2368:x1876096812424576:12345-192.168.202.54@tcp:39:umount.0 Request processed in 1149us (1363us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1789185653.863051:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 240 00000100:00100000:0.0:1789185653.887172:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185653.887319:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812424832 00000100:00100000:1.0:1789185653.887331:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812424832 00000100:00100000:1.0:1789185653.887398:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 305 00000100:00100000:1.0:1789185653.887440:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+7:2368:x1876096812424832:12345-192.168.202.54@tcp:251:umount.0 00000020:00000080:1.0:1789185653.887484:0:5816:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b927 00000020:00010000:1.0:1789185653.887492:0:5816:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c7936d81000: total 0 00000100:00080000:1.0:1789185653.887497:0:5816:0:(import.c:65:import_set_state_nolock()) ffff9c7936d82800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789185653.887589:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5241da3d-acea-4d5e-9360-a7cef404ad9c+3:2368:x1876096812424832:12345-192.168.202.54@tcp:251:umount.0 Request processed in 182us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185653.887598:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 305 00000020:00010000:0.0:1789185653.888348:0:5812:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c7936d81000: total 0 00010000:00010000:0.0:1789185653.888399:0:5812:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c7936d81000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789185653.888503:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c794216c600/0x532743011272b9dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d3fb expref: 2 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185653.888519:0:5812:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c7936d81000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789185653.888531:0:5812:0:(genops.c:885:class_export_put()) final put ffff9c7936d81000/5241da3d-acea-4d5e-9360-a7cef404ad9c 00010000:00010000:0.0:1789185653.888548:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185653.888550:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185653.888551:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789185653.888697:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7936d81000/5241da3d-acea-4d5e-9360-a7cef404ad9c for MGS 00000020:00000080:3.0:1789185653.888728:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7936d82800 for MGS 00010000:00010000:3.0:1789185653.903919:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185654.671755:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185654.671780:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821838720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185654.671855:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185654.671964:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821838720 00000100:00100000:3.0:1789185654.671973:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821838720 00000100:00100000:3.0:1789185654.672040:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789185654.672050:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821838720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185654.672090:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185654.672135:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821838720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185654.672143:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789185654.672222:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821838720:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789185654.672399:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185654.672676:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821839232:0@lo:400:kworker.0 00000100:00100000:1.0:1789185654.672711:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185654.672734:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185654.672739:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821839104:0@lo:400:kworker.0 00000100:00100000:1.0:1789185654.672764:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185654.672792:0:12523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821839232 00000100:00100000:1.0:1789185654.672797:0:12523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821839232 00000100:00100000:1.0:1789185654.672831:0:12523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789185654.672839:0:12523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821839232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185654.672876:0:12523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821839232:12345-0@lo:400:kworker.0 Request processed in 38us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185654.672882:0:12523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789185654.672902:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821839104 00000100:00100000:1.0:1789185654.672906:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821839104 00000100:00100000:1.0:1789185654.672941:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789185654.672948:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821839104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185654.672977:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821839104:12345-0@lo:400:kworker.0 Request processed in 30us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185654.672983:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:1.0:1789185654.673004:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185654.673007:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185654.673024:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821839104:0@lo:400:kworker.0 00000100:00100000:1.0:1789185654.673033:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821839232:0@lo:400:kworker.0 00000100:00100000:0.0:1789185654.673102:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821838976:0@lo:400:kworker.0 00000100:00100000:0.0:1789185654.673130:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185654.673156:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789185654.673161:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821838848:0@lo:400:kworker.0 00000100:00100000:0.0:1789185654.673185:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185654.673206:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1876096821839360:0@lo:400:kworker.0 00000100:00100000:0.0:1789185654.673225:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185654.673295:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821838848 00000100:00100000:2.0:1789185654.673299:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821838848 00000100:00100000:2.0:1789185654.673334:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789185654.673341:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c790729e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3279:x1876096821838848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185654.673378:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c790729e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3279:x1876096821838848:12345-0@lo:400:kworker.0 Request processed in 38us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185654.673384:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789185654.673430:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821838976 00000100:00100000:2.0:1789185654.673434:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821838976 00000100:00100000:2.0:1789185654.673454:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821839360 00000100:00100000:2.0:1789185654.673456:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821839360 00000100:00100000:2.0:1789185654.673790:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789185654.673797:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821838976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185654.673840:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821838976:12345-0@lo:400:kworker.0 Request processed in 33us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185654.673847:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789185654.673859:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789185654.673864:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876096821839360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185654.673892:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876096821839360:12345-0@lo:400:kworker.0 Request processed in 28us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185654.673897:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789185654.673930:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ad68fcc-785c-4134-99e9-eee8a8012753:3279:1876096821838848:0@lo:400:kworker.0 00000100:00100000:2.0:1789185654.673943:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1876096821839360:0@lo:400:kworker.0 00000100:00100000:2.0:1789185654.673952:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821838976:0@lo:400:kworker.0 00000100:00080000:1.0:1789185654.675148:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789185654.735746:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789185654.735757:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789185654.736233:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1789185654.736241:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789185654.928522:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789185655.232652:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000020:00000080:2.0:1789185655.232667:0:6703:0:(genops.c:885:class_export_put()) final put ffff9c792fae3000/19bfb1a3-97ed-41fd-ac10-946cffd5be7d 00000020:00000080:3.0:1789185655.236585:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c792fae3000/19bfb1a3-97ed-41fd-ac10-946cffd5be7d for lustre-OST0000 00000020:00000080:3.0:1789185655.239161:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c791a5a7800 for lustre-OST0000 00000100:00100000:3.0:1789185655.703708:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7803234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821839488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185655.703782:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185655.703857:0:8180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821839488 00000100:00100000:3.0:1789185655.703864:0:8180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821839488 00000100:00100000:3.0:1789185655.703924:0:8180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789185655.703935:0:8180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821839488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185655.703969:0:8180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185655.704013:0:8180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821839488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185655.704021:0:8180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789185655.704080:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7803234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821839488:0@lo:13:osp-pre-0-0.0 00000020:01000004:1.0:1789185655.802066:0:12970:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789185655.837031:0:12970:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789185655.837084:0:12970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185655.837100:0:12970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b9b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185655.837108:0:12970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b9b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185655.837116:0:12970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b9b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185655.837148:0:12970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789185655.837153:0:12970:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789185655.837174:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789185655.837179:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789185655.837186:0:12970:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789185655.837212:0:12970:0:(import.c:65:import_set_state_nolock()) ffff9c79405c2800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789185655.837352:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876096821839616:0@lo:39:umount.0 00000100:00100000:3.0:1789185655.837477:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185655.837790:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185655.837797:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b9b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185655.837806:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c794216cc00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:0.0:1789185655.837809:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b9b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185655.837817:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x532743011272b9b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185655.837824:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x532743011272b9b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185655.837835:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789185655.837838:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789185655.837840:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789185655.837866:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272b9b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185655.837872:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185655.837986:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272b9b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185655.837993:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c794216cc00/0x532743011272b9ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272b9b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185655.838007:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185655.838009:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185655.838010:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185655.838050:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185655.838061:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821839744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185655.838095:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185655.838296:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821839744 00000100:00100000:0.0:1789185655.838303:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821839744 00000100:00100000:0.0:1789185655.838361:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789185655.838371:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821839744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185655.838384:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185655.838400:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c793fe05e00/0x532743011272b9b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x532743011272b9ac expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185655.838455:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185655.838498:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ad68fcc-785c-4134-99e9-eee8a8012753+18:3281:x1876096821839744:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185655.838505:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789185655.838584:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821839744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789185655.839019:0:12880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821839616 00000100:00100000:1.0:1789185655.839031:0:12880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821839616 00000100:00100000:1.0:1789185655.839061:0:12880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789185655.839068:0:12880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7803234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876096821839616:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789185655.839092:0:12880:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b736 00000100:00080000:1.0:1789185655.839099:0:12880:0:(import.c:65:import_set_state_nolock()) ffff9c7940b54800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789185655.839128:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185655.839170:0:12880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7803234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3277:x1876096821839616:12345-0@lo:39:umount.0 Request processed in 102us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185655.839177:0:12880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1789185655.839184:0:12880:0:(genops.c:885:class_export_put()) final put ffff9c7940535000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1789185655.839253:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c79405c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789185655.839282:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876096821839616:0@lo:39:umount.0 00000020:00000080:2.0:1789185655.839335:0:486:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7940535000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789185655.839391:0:486:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7940b54800 for lustre-MDT0000 00000100:00080000:1.0:1789185655.839861:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789185655.839864:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789185655.839868:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789185655.841265:0:12970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841282:0:12970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b9c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841300:0:12970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b9c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841306:0:12970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b9c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841324:0:12970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185655.841330:0:12970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b8e8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841335:0:12970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b8e8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841340:0:12970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b8e8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841346:0:12970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b8e8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841357:0:12970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789185655.841364:0:12970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272bbea expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841369:0:12970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272bbea expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841374:0:12970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272bbea expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841390:0:12970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272bbea expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841400:0:12970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789185655.841425:0:12970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901521600/0x532743011272b695 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b69c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841433:0:12970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901521600/0x532743011272b695 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b69c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841438:0:12970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7901521600/0x532743011272b695 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b69c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841444:0:12970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9c7901521600/0x532743011272b695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b69c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185655.841451:0:12970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1789185655.841455:0:12970:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1789185655.841478:0:12970:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789185655.841482:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789185655.841486:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185655.841493:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1789185655.841499:0:12970:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c792fb0d800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789185655.841504:0:12970:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c793f286000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789185655.841511:0:12970:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9c792fb09800 8c8f5f6e-29cb-49a9-885e-2459dbca0795 192.168.202.54@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789185655.841516:0:12970:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9c7936dd0000) has exports, disconnecting them 00000020:00080000:1.0:1789185655.841520:0:12970:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c792fb0d800), last request at 1789185654 00000020:00000080:1.0:1789185655.841533:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b8a9 00000100:00080000:1.0:1789185655.841547:0:12970:0:(import.c:65:import_set_state_nolock()) ffff9c792fb08000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789185655.841585:0:12970:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c792fb0d800): rc 0 00000020:00000080:1.0:1789185655.841587:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c792fb0d800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1789185655.841666:0:11163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789185655.841673:0:11163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b9c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.841680:0:11163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04600 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185655.841692:0:11163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b9c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.841701:0:11163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x532743011272b9c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185655.841708:0:11163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x532743011272b9c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185655.841713:0:11163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789185655.841715:0:11163:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789185655.841718:0:11163:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1789185655.841749:0:11163:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272b9c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.841755:0:11163:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185655.841786:0:11163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272b9c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.841792:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272b9ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272b9c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.841811:0:11163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789185655.841814:0:11163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b8e8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.841820:0:11163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05600 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185655.841823:0:11163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b8e8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.841831:0:11163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x532743011272b8e8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185655.841837:0:11163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x532743011272b8e8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185655.841842:0:11163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789185655.841844:0:11163:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789185655.841846:0:11163:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789185655.841859:0:11163:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272b8e8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.841865:0:11163:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185655.841877:0:11163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272b8e8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.841884:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c793fe05600/0x532743011272b8e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272b8e8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.841895:0:11163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185655.841898:0:11163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272bbea expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.841909:0:11163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4da00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185655.841912:0:11163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272bbea expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.841918:0:11163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x532743011272bbea expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185655.841923:0:11163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x532743011272bbea expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185655.841927:0:11163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789185655.841929:0:11163:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789185655.841931:0:11163:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789185655.841943:0:11163:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272bbea expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.841949:0:11163:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185655.841954:0:11163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272bbea expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.841961:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7936b4da00/0x532743011272bbe3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272bbea expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.841970:0:11163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185655.841973:0:11163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7901521600/0x532743011272b695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b69c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185655.842010:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821839872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185655.842073:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789185655.842205:0:11163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7901521600 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185655.842209:0:11163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7901521600/0x532743011272b695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b69c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.842221:0:11163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7901521600/0x532743011272b695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x532743011272b69c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185655.842229:0:11163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7901521600/0x532743011272b695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x532743011272b69c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185655.842235:0:11163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789185655.842237:0:11163:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789185655.842238:0:11163:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789185655.842261:0:11163:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7901521600/0x532743011272b695 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272b69c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.842266:0:11163:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185655.842280:0:11163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7901521600/0x532743011272b695 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272b69c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.842287:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7901521600/0x532743011272b695 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272b69c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.842297:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185655.842299:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185655.842300:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185655.842327:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185655.842335:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821840256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185655.842357:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185655.842382:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821839872 00000100:00100000:2.0:1789185655.842387:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821839872 00000100:00100000:2.0:1789185655.842434:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821840256 00000100:00100000:2.0:1789185655.842437:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821840256 00000100:00100000:2.0:1789185655.842453:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789185655.842460:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+19:3281:x1876096821839872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789185655.842472:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185655.842483:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c794216dc00/0x532743011272b9c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x532743011272b9ba expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185655.842494:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185655.842521:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+18:3281:x1876096821839872:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185655.842527:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789185655.842539:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789185655.842544:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793081dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+17:3281:x1876096821840256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789185655.842549:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185655.842555:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79013ec600/0x532743011272b69c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x532743011272b695 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185655.842564:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185655.842579:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793081dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad68fcc-785c-4134-99e9-eee8a8012753+16:3281:x1876096821840256:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185655.842592:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789185655.842637:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821840256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185655.842644:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821839872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185655.843004:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821840000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185655.843031:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185655.843056:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185655.843062:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821840128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185655.843081:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185655.843103:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821840000 00000100:00100000:3.0:1789185655.843107:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821840000 00000100:00100000:3.0:1789185655.843134:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821840128 00000100:00100000:3.0:1789185655.843136:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821840128 00000100:00100000:3.0:1789185655.843148:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185655.843154:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ad68fcc-785c-4134-99e9-eee8a8012753+17:3278:x1876096821840000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185655.843162:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185655.843170:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79013eca00/0x532743011272b8e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x532743011272b8e1 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.843182:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185655.843212:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ad68fcc-785c-4134-99e9-eee8a8012753+16:3278:x1876096821840000:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185655.843217:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185655.843229:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789185655.843234:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ad68fcc-785c-4134-99e9-eee8a8012753+15:3278:x1876096821840128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185655.843252:0:6692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185655.843261:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7907354400/0x532743011272bbea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x532743011272bbe3 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185655.843269:0:6692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185655.843289:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ad68fcc-785c-4134-99e9-eee8a8012753+14:3278:x1876096821840128:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185655.843293:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789185655.843311:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821840128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185655.843316:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ad68fcc-785c-4134-99e9-eee8a8012753:3278:1876096821840000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185655.843328:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789185655.845161:0:12970:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c793f286000), last request at 1789185654 00000020:00000080:1.0:1789185655.845174:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b7de 00000100:00080000:1.0:1789185655.845186:0:12970:0:(import.c:65:import_set_state_nolock()) ffff9c793f283800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789185655.845208:0:12970:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c793f286000): rc 0 00000020:00000080:1.0:1789185655.845211:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c793f286000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1789185655.845220:0:12970:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffadbe416abae0 00000100:00080000:1.0:1789185655.845252:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789185655.845256:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1789185655.845267:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789185655.845323:0:12970:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789185655.845347:0:12970:0:(import.c:65:import_set_state_nolock()) ffff9c793f2db000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789185655.845366:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789185655.845368:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1789185655.845377:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:3.0:1789185655.845403:0:486:0:(genops.c:844:class_export_destroy()) destroying export ffff9c792fb0d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:1.0:1789185655.845460:0:12970:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789185655.845468:0:12970:0:(import.c:65:import_set_state_nolock()) ffff9c794102d000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:3.0:1789185655.845480:0:486:0:(genops.c:844:class_export_destroy()) destroying export ffff9c793f286000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00080000:1.0:1789185655.845496:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9c7936dd0000) has no exports 00000020:00000080:3.0:1789185655.845518:0:486:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c792fb08000 for lustre-MDT0000 00000020:00000080:3.0:1789185655.845523:0:486:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c793f283800 for lustre-MDT0000 00010000:00010000:3.0:1789185655.845538:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185655.848227:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185655.848268:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821840384:0@lo:9:umount.0 00000100:00100000:0.0:1789185655.848345:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185655.848382:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821840512:0@lo:9:umount.0 00000100:00100000:0.0:1789185655.848438:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185655.848479:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821840384 00000100:00100000:0.0:1789185655.848487:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821840384 00000100:00100000:0.0:1789185655.848530:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821840512 00000100:00100000:0.0:1789185655.848533:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821840512 00000100:00100000:0.0:1789185655.848556:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789185655.848564:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1876096821840384:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789185655.848594:0:6679:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b839 00000100:00080000:0.0:1789185655.848607:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9c7936995800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789185655.848640:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789185655.848959:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3277:x1876096821840384:12345-0@lo:9:umount.0 Request processed in 395us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185655.848968:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789185655.848982:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789185655.848988:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1876096821840512:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789185655.848999:0:6679:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b912 00000100:00080000:0.0:1789185655.849005:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9c7936d84000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789185655.849022:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789185655.849196:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3277:x1876096821840512:12345-0@lo:9:umount.0 Request processed in 208us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185655.849203:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789185655.849260:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c793f2db000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789185655.849285:0:3277:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789185655.849287:0:3277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789185655.849291:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821840384:0@lo:9:umount.0 00000100:00080000:0.0:1789185655.849305:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c794102d000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789185655.849314:0:3277:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789185655.849316:0:3277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789185655.849318:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821840512:0@lo:9:umount.0 00010000:00010000:0.0:1789185655.850182:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185655.851477:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789185655.855920:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9c7936dd0000) has no exports 00000020:00000080:1.0:1789185656.004311:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b6f0 00000020:00000080:1.0:1789185656.004336:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c7940b54000/lustre-QMT0000_UUID 00000020:01000000:1.0:1789185656.004369:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789185656.004939:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789185656.004957:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789185656.004964:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9c7910780000) has no exports 00000020:00000080:0.0:1789185656.006483:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7940b54000/lustre-QMT0000_UUID for lustre-QMT0000 00010000:00010000:0.0:1789185656.006594:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789185656.009683:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b6e9 00000020:00000080:2.0:1789185656.009698:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c7939aa5800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789185656.009840:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789185656.009852:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789185656.009855:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c79405c7800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789185656.009858:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff9c79405c7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789185656.009867:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1789185656.010322:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7939aa5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789185657.040382:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789185657.812188:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789185657.812199:0:7633:0:(genops.c:885:class_export_put()) final put ffff9c7936d80000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789185657.812339:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7936d80000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789185657.812423:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7936d84000 for lustre-OST0001 00000001:00100000:1.0:1789185657.835476:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8c8f5f6e-29cb-49a9-885e-2459dbca0795 00000001:00080000:1.0:1789185657.835508:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1789185657.835533:0:5844:0:(genops.c:885:class_export_put()) final put ffff9c792fb09800/8c8f5f6e-29cb-49a9-885e-2459dbca0795 00000020:00000080:0.0:1789185657.835641:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9c792fb09800/8c8f5f6e-29cb-49a9-885e-2459dbca0795 for lustre-MDT0000 00000020:00000080:0.0:1789185657.835820:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c792fb0b800 for lustre-MDT0000 00000020:01000000:2.0:1789185658.063662:0:12970:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c79365c4180 - data ffff9c790d007798/ffff9c793f572000 00010000:00010000:3.0:1789185658.064609:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789185658.064932:0:12970:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c79073574e0 - data ffff9c792a78c510/ffff9c7941b8a800 00000001:00000004:0.0:1789185658.095929:0:12970:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1789185658.232727:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789185658.232739:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789185658.232775:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789185658.232778:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789185658.233953:0:6875:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789185658.233963:0:6875:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789185658.233977:0:6875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789185658.236248:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789185658.236260:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1789185658.236284:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789185658.236288:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789185658.237249:0:7963:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789185658.237258:0:7963:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789185658.237273:0:7963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789185658.434758:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b6b8 00000020:00000080:1.0:1789185658.434777:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c7936dcf800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789185658.436148:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7936dcf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789185658.449489:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b6cd 00000020:00000080:1.0:1789185658.449509:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c7936de9800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789185658.449533:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789185658.449543:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185658.449554:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789185658.449561:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9c7936dd19c0) has no exports 00000020:00000080:0.0:1789185658.449998:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7936de9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1789185658.450104:0:12970:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789185658.450117:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b90b 00000020:00000080:1.0:1789185658.450123:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c78011b3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789185658.450140:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789185658.450146:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185658.450154:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789185658.450157:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9c792f800000) has no exports 00000020:00000080:1.0:1789185658.450166:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b904 00000020:00000080:1.0:1789185658.450171:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c794102e800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789185658.450242:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c78011b3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789185658.450251:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c794102e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789185658.452755:0:12970:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789185658.452768:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789185658.452785:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1789185658.452796:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789185658.452799:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789185658.452932:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185658.452950:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789185658.452962:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b824 00000020:00000080:1.0:1789185658.452973:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c793f2bf800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789185658.452982:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789185658.452987:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185658.452992:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:0.0:1789185658.452995:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c794102d000 for lustre-OST0001-osc-MDT0000 00000020:00080000:1.0:1789185658.452997:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9c7907230000) has no exports 00000020:00000080:1.0:1789185658.453005:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b81d 00000020:00000080:0.0:1789185658.453067:0:36:0:(genops.c:885:class_export_put()) final put ffff9c794102e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789185658.453072:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c794102e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789185658.453082:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789185658.453086:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c793f2dd800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789185658.453186:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c793f2bf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789185658.453191:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c793f2dd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789185658.455565:0:12970:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789185658.455577:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789185658.455584:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789185658.455595:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789185658.455598:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789185658.455668:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185658.455685:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789185658.455727:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185658.455731:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789185658.455740:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c7936dcc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789185658.455744:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7936dcc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789185658.455754:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789185658.455798:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c793f2db000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789185658.455808:0:38:0:(genops.c:885:class_export_put()) final put ffff9c793f2d8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789185658.455822:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9c793f2d8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789185658.455835:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789185658.456985:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b6d4 00000020:00000080:1.0:1789185658.457001:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c7936dec800/lustre-MDD0000_UUID 00000020:01000000:1.0:1789185658.457020:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789185658.457036:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185658.457044:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789185658.457050:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9c7936dd4d40) has no exports 00000020:00000080:1.0:1789185658.457075:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185658.457081:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789185658.457086:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b6db 00000020:00000080:1.0:1789185658.457091:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c7936de8000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789185658.457101:0:12970:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c79102db000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789185658.457104:0:12970:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c79102db000 3 00000020:01000004:1.0:1789185658.457108:0:12970:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c79102db000 from lustre-MDT0000 00000020:00000080:1.0:1789185658.457129:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185658.457133:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789185658.457136:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c7936dca800/lustre-MDT0000_UUID 00000020:00000080:1.0:1789185658.457138:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7936dca800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789185658.457148:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789185658.457175:0:12970:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789185658.457192:0:12970:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789185658.457195:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789185658.457198:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185658.457201:0:12970:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789185658.457208:0:12970:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9c79102d8800 8ad68fcc-785c-4134-99e9-eee8a8012753 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789185658.457225:0:12970:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9c79107819c0) has exports, disconnecting them 00000020:00080000:1.0:1789185658.457231:0:12970:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c79102d8800), last request at 1789185421 00000020:00000080:1.0:1789185658.457250:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b679 00000020:00010000:1.0:1789185658.457255:0:12970:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c79102d8800: total 2 00000100:00080000:1.0:1789185658.457260:0:12970:0:(import.c:65:import_set_state_nolock()) ffff9c7902dc0800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789185658.457279:0:12970:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c79102d8800): rc 0 00000020:00080000:1.0:1789185658.457284:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9c79107819c0) has no exports 00000020:00010000:0.0:1789185658.457324:0:5812:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c79102d8800: total 2 00000100:00100000:1.0:1789185658.457350:0:5817:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c790536a200:5817] 2 exiting: rc = 0 00010000:00010000:0.0:1789185658.457359:0:5812:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c79102d8800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789185658.457391:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d7200/0x532743011272bbce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x532743011272bbc7 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185658.457430:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7901521400/0x532743011272b791 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x532743011272b78a expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185658.457446:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d7e00/0x532743011272b9cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x532743011272b9c8 expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185658.457455:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d7a00/0x532743011272bbdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x532743011272bbd5 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185658.457467:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c793fe04000/0x532743011272b97b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x532743011272b974 expref: 5 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185658.457477:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d7800/0x532743011272b989 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x532743011272b982 expref: 4 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185658.457488:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79234d6800/0x532743011272b9a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x532743011272b99e expref: 3 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185658.457498:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79013ec400/0x532743011272b997 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x532743011272b990 expref: 2 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185658.457508:0:5812:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c79102d8800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789185658.457521:0:5812:0:(genops.c:885:class_export_put()) final put ffff9c79102d8800/8ad68fcc-785c-4134-99e9-eee8a8012753 00010000:00010000:0.0:1789185658.457531:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185658.457540:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185658.457543:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185658.458695:0:5816:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c7906bcb600:5816] 1 exiting: rc = 0 00000020:00000080:2.0:1789185658.461458:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7936dec800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789185658.461474:0:38:0:(genops.c:885:class_export_put()) final put ffff9c7936de9000/lustre-MDD0000_UUID 00000020:00000080:2.0:1789185658.461478:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7936de9000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789185658.461485:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1789185658.461697:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7936de8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789185658.461705:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9c79102d8800/8ad68fcc-785c-4134-99e9-eee8a8012753 for MGS 00000020:00000080:2.0:1789185658.461759:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7902dc0800 for MGS 00000100:00100000:2.0:1789185658.461809:0:5815:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c7906bca400:5815] 0 exiting: rc = 1 00000100:00100000:1.0:1789185658.465682:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465696:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465704:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465712:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465719:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465725:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465731:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465739:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465746:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465752:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465758:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465765:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465774:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465780:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465786:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465791:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465797:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465802:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465808:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465815:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465841:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465848:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465855:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465871:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465878:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465885:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465891:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465897:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465903:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465910:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465917:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465924:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465931:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465937:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465943:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465950:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465956:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465966:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465973:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465979:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465985:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465991:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.465997:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466004:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466011:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466018:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466024:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466030:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466036:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466042:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466047:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466054:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466060:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466066:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466071:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466085:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466092:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466099:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466106:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466112:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466118:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466124:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466130:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185658.466136:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789185658.466656:0:12970:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789185658.466660:0:12970:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1789185658.467846:0:12970:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c790818c900 - data ffff9c790d04eaf8/ffff9c792f625000 00000020:01000000:1.0:1789185658.468059:0:12970:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c79063faa20 - data ffff9c792a748e58/ffff9c7930821000 00000020:00000080:1.0:1789185658.475036:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b65d 00000020:00000080:1.0:1789185658.475054:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c7907f9a000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789185658.475090:0:12970:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c79102db000 from MGS, refs=2 00000020:01000004:1.0:1789185658.475094:0:12970:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c79102db000 2 00000020:01000004:1.0:1789185658.475099:0:12970:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c79102db000 from MGS 00000020:00000080:0.0:1789185658.475128:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7907f9a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789185658.475139:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185658.475150:0:12970:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789185658.475154:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c79102df800/MGS 00000020:00000080:1.0:1789185658.475156:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff9c79102df800/MGS for MGS 00000020:01000000:1.0:1789185658.475171:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789185658.475284:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789185658.475290:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185658.475297:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789185658.475305:0:12970:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c7907371000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789185658.475312:0:12970:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9c7910784d40) has exports, disconnecting them 00000020:00080000:1.0:1789185658.475319:0:12970:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c7907371000), last request at 1789185422 00000020:00000080:1.0:1789185658.475325:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b728 00000020:00080000:1.0:1789185658.475338:0:12970:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7907371000): rc 0 00000020:00000080:1.0:1789185658.475343:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c7907371000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789185658.475390:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7907371000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789185658.491599:0:12970:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789185658.491615:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789185658.491621:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789185658.491631:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789185658.491714:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c79405c2800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789185658.491925:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185658.491939:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789185658.491947:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c7939aa0800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789185658.491952:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7939aa0800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789185658.491985:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789185658.492066:0:12970:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c79102db000 1 00000020:00000080:0.0:1789185658.492073:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b64f 00000020:00000080:0.0:1789185658.492082:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c79102dc800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789185658.492099:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789185658.492105:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789185658.492111:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:2.0:1789185658.492113:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c79102dc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:0.0:1789185658.492115:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9c7910783380) has no exports 00000020:00000080:2.0:1789185658.611105:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789185658.611126:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789185658.611134:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c79102da800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789185658.611141:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff9c79102da800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789185658.611159:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789185658.611358:0:12970:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c79102d9800 00000020:01000000:2.0:1789185658.611388:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789185658.611394:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789185658.611400:0:12970:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789185658.611433:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9c7906618000) has no exports 00000100:00100000:2.0:1789185658.611541:0:5823:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9c7906bdee00:5823] 1 exiting: rc = 0 00000100:00100000:2.0:1789185658.611675:0:5822:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9c7906bdfe00:5822] 0 exiting: rc = 1 00000100:00100000:3.0:1789185658.612200:0:11024:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9c792fae9800:11024] 3 exiting: rc = 0 00000100:00100000:1.0:1789185658.618242:0:5824:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9c7910fc6000:5824] 2 exiting: rc = 0 00000100:00100000:1.0:1789185658.618393:0:12880:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff9c7802df1800:12880] 4 exiting: rc = 0 00000100:00100000:2.0:1789185658.622128:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622142:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622148:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622161:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622168:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622173:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622202:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622209:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622227:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622234:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622240:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622245:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622251:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622256:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622263:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622268:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622274:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622280:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622286:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622292:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622298:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622304:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622310:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622317:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622325:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622331:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622337:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622343:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622350:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622356:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622364:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622369:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622375:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622381:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622388:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622396:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622421:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622430:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622437:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622445:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622451:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622465:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622471:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622477:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622483:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622489:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622497:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622503:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622515:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622521:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622527:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622534:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622540:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622545:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622551:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622557:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622564:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622569:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622575:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622581:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622586:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622593:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622600:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.622606:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.648336:0:5826:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c7905b50800:5826] 1 exiting: rc = 0 00000100:00100000:0.0:1789185658.648532:0:12524:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9c780320a000:12524] 2 exiting: rc = 0 00000100:00100000:2.0:1789185658.653332:0:5825:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c7910e50a00:5825] 0 exiting: rc = 1 00000100:00100000:0.0:1789185658.653767:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653808:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653815:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653823:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653833:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653841:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653852:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653859:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653879:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653886:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653892:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653899:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653907:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653913:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653919:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653924:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653930:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653936:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653941:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653946:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653951:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653955:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653960:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653965:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653970:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653974:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653979:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653985:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653991:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.653996:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654002:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654008:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654014:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654019:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654024:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654031:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654036:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654042:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654048:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654053:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654059:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654065:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654071:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654084:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654089:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654095:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654100:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654106:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654113:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654119:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654129:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654135:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654142:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654148:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654154:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654159:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654164:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654169:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654175:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654180:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654184:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654190:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654196:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.654201:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.656231:0:5828:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9c7907350e00:5828] 1 exiting: rc = 0 00000100:00100000:1.0:1789185658.657689:0:5827:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9c7905b51a00:5827] 0 exiting: rc = 1 00000100:00100000:0.0:1789185658.658551:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658562:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658569:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658576:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658583:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658589:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658595:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658602:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658609:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658628:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658635:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658641:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658648:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658658:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658679:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658685:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658691:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658698:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658705:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658712:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658726:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658745:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658752:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.658758:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659114:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659125:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659135:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659143:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659152:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659159:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659169:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659176:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659182:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659203:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659210:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659226:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659233:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659240:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659246:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659252:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659259:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659268:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659278:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659284:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659291:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659309:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659317:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659324:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659329:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659346:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659352:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659360:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659367:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659373:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659603:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659613:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659619:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659640:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659648:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659654:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659661:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659667:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659673:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.659686:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.671857:0:5829:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c79191c3800:5829] 0 exiting: rc = 1 00000100:00100000:1.0:1789185658.672093:0:5830:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c7907351c00:5830] 1 exiting: rc = 0 00000100:00100000:0.0:1789185658.672285:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672293:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672298:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672304:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672310:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672316:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672322:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672327:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672333:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672339:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672345:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672351:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672358:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672364:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672369:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672374:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672380:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672385:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672390:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672461:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672482:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672487:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672492:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672498:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672503:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672507:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672513:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672517:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672522:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672526:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672531:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672536:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672543:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672549:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672554:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672560:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672565:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672570:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672574:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672579:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672585:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672590:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672595:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672601:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672605:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672610:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672615:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672620:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672625:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672630:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672634:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672638:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672642:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672647:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672651:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672662:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672666:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672672:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672677:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672681:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672686:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672691:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672695:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.672700:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.673342:0:5832:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c7907350400:5832] 1 exiting: rc = 0 00000100:00100000:2.0:1789185658.673476:0:5831:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c7907343600:5831] 0 exiting: rc = 1 00000100:00100000:0.0:1789185658.673604:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673610:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673616:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673621:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673630:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673635:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673641:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673646:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673651:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673656:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673662:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673667:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673672:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673680:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673686:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673691:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673696:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673701:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673707:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673712:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673716:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673721:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673725:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673730:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673734:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673739:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673752:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673756:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673761:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673767:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673772:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673777:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673782:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673787:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673791:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673796:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673801:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673806:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673810:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673815:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673820:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673825:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673830:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673835:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673839:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673844:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673857:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673862:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673867:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673871:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673876:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673881:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673885:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673890:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673895:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673899:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673904:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673909:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673914:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673918:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673923:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673932:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673936:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.673941:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.674386:0:5834:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c7907350000:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1789185658.674569:0:5833:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c7907343e00:5833] 0 exiting: rc = 1 00000100:00100000:0.0:1789185658.674738:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674744:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674750:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674756:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674761:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674766:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674770:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674775:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674780:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674784:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674789:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674794:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674798:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674825:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674831:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674836:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674841:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674892:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674899:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674905:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674910:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674915:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674919:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674924:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674929:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674934:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674939:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674944:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674948:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674953:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674957:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674962:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674976:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674981:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674986:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674992:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.674997:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675002:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675008:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675013:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675018:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675023:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675030:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675036:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675041:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675046:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675052:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675058:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675063:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675069:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675076:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675082:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675088:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675093:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675099:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675105:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675111:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675120:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675126:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675131:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675139:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675144:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675149:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.675154:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185658.676008:0:5835:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9c7907342200:5835] 0 exiting: rc = 1 00000100:00100000:2.0:1789185658.676242:0:5836:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9c791034a200:5836] 1 exiting: rc = 0 00000100:00100000:1.0:1789185658.676642:0:5837:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9c791034a400:5837] 2 exiting: rc = 0 00000100:00100000:0.0:1789185658.676813:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676825:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676832:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676904:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676912:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676918:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676924:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676930:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676936:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676941:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676949:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676956:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676961:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676966:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676972:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676979:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676984:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676990:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.676996:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677002:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677009:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677014:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677021:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677027:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677048:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677056:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677062:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677068:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677075:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677081:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677087:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677094:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677101:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677108:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677115:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677125:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677131:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677137:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677149:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677158:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677165:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677171:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677176:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677182:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677188:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677193:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677199:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677204:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677230:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677237:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677243:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677248:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677253:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677259:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677265:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677271:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677276:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677281:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677286:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677291:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677296:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677302:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677308:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185658.677314:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789185658.682199:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185658.682228:0:12970:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789185658.682236:0:12970:0:(genops.c:885:class_export_put()) final put ffff9c791f9b3000/MDS_uuid 00000020:00000080:0.0:1789185658.682241:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff9c791f9b3000/MDS_uuid for MDS 00000020:01000000:0.0:1789185658.682267:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789185658.682498:0:12970:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789185659.087635:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185659.794707:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821840640:0@lo:400:kworker.0 00000400:00000100:0.0:1789185659.794791:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876096821840640 offset 0 length 224: 4 00000100:00100000:3.0:1789185659.801509:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821840768:0@lo:400:kworker.0 00000400:00000100:3.0:1789185659.801594:0:3278:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096821840768 offset 0 length 224: 4 00000100:00100000:3.0:1789185659.801643:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185659.801650:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821840896:0@lo:400:kworker.0 00000400:00000100:3.0:1789185659.801669:0:3278:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096821840896 offset 0 length 224: 4 00010000:00010000:3.0:1789185660.120084:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789185660.383812:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789185660.383825:0:6703:0:(genops.c:885:class_export_put()) final put ffff9c7936994000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789185660.383887:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7936994000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789185660.383976:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7936995800 for lustre-OST0000 00010000:00010000:1.0:1789185661.135631:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789185661.859115:0:13137:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789185661.873583:0:13137:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789185661.873653:0:13137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b997 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185661.873672:0:13137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b997 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185661.873681:0:13137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b997 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185661.873689:0:13137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b997 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185661.873721:0:13137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789185661.873728:0:13137:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789185661.873756:0:13137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789185661.873772:0:13137:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c793f25ce00 x1876096821840768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185675 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185661.873791:0:13137:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789185661.873799:0:13137:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1789185661.874275:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185661.874286:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b997 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185661.874295:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c794216ce00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185661.874299:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b997 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185661.874309:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x532743011272b997 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185661.874317:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x532743011272b997 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185661.874323:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789185661.874326:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789185661.874329:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789185661.874372:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272b997 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185661.874397:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185661.874449:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272b997 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185661.874456:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c794216ce00/0x532743011272b990 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x532743011272b997 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185661.874471:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185661.874473:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185661.874475:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185661.874514:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821840768:0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.874555:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821841024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185661.874637:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185661.874728:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821841024 00000100:00100000:3.0:1789185661.874738:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821841024 00000100:00100000:3.0:1789185661.874794:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789185661.874802:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3280:x1876096821841024:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789185661.874809:0:6692:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789185661 with bad export cookie 5991831501123270265 00000100:00080000:2.0:1789185661.874951:0:13137:0:(import.c:65:import_set_state_nolock()) ffff9c7936dc8800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789185661.875367:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1876096821841152:0@lo:39:umount.0 00000400:00000100:0.0:1789185661.875434:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096821841152 offset 0 length 224: 4 00000100:00100000:3.0:1789185661.901250:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3280:x1876096821841024:12345-0@lo:103:ldlm_bl.0 Request processed in 26434us (26600us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789185661.901270:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789185661.901320:0:3280:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789185661.901328:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9c7904f01800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789185661.901333:0:3280:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.154@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789185661.910532:0:3280:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.154@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789185661.910541:0:3280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789185661.910554:0:3280:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c793f25d880 x1876096821840640/t0(0) o400->MGC192.168.202.154@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789185675 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185661.910624:0:3280:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c793fc84000 x1876096821841024/t0(0) o103->MGC192.168.202.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789185677 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789185661.910635:0:3280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789185661.910638:0:3280:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789185661.910640:0:3280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789185661.910645:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9c7904f01800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789185661.910651:0:3280:0:(import.c:545:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 118 00000100:00080000:2.0:1789185661.910669:0:3280:0:(import.c:666:import_select_connection()) MGC192.168.202.154@tcp: import ffff9c7904f01800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:1.0:1789185661.910845:0:3280:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7904d5f800 x1876096821841280/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789185661.910900:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ad68fcc-785c-4134-99e9-eee8a8012753:3280:1876096821841024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185661.911040:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ad68fcc-785c-4134-99e9-eee8a8012753:3281:1876096821840640:0@lo:400:kworker.0 00000100:00100000:2.0:1789185661.911219:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8ad68fcc-785c-4134-99e9-eee8a8012753:3277:1876096821841280:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1789185661.911278:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876096821841280 offset 0 length 520: 4 00010000:00010000:3.0:1789185662.159777:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185663.183651:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185664.207655:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789185664.911924:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8ad68fcc-785c-4134-99e9-eee8a8012753->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789185664.911938:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8ad68fcc-785c-4134-99e9-eee8a8012753->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789185664.912124:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821841408:0@lo:400:kworker.0 00000400:00000100:0.0:1789185664.912194:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096821841408 offset 0 length 224: 4 00010000:00010000:3.0:1789185665.232126:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185666.255643:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789185666.960196:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8ad68fcc-785c-4134-99e9-eee8a8012753->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789185666.960208:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8ad68fcc-785c-4134-99e9-eee8a8012753->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789185666.960318:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185666.960338:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1876096821841536:0@lo:400:kworker.0 00000400:00000100:2.0:1789185666.960396:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096821841536 offset 0 length 224: 4 00010000:00010000:3.0:1789185667.279834:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185668.303919:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185669.329109:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185670.351648:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185671.055662:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185661/real 1789185661] req@ffff9c7904d5f800 x1876096821841280/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789185671 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185671.055708:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7904d5f800 x1876096821841280/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789185671 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185671.055720:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185661/real 1789185661] req@ffff9c793f25d180 x1876096821841152/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789185671 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185671.055736:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c793f25d180 x1876096821841152/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789185671 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789185671.055755:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c7904f01800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789185671.055782:0:3277:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789185671.055786:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8ad68fcc-785c-4134-99e9-eee8a8012753:3277:1876096821841280:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1789185671.055793:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c7936dc8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789185671.055809:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1876096821841152:0@lo:39:umount.0 00000100:00080000:2.0:1789185671.056455:0:13137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789185671.056461:0:13137:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789185671.056467:0:13137:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789185671.057749:0:13137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b9a5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185671.057767:0:13137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b9a5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185671.057774:0:13137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b9a5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185671.057781:0:13137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b9a5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185671.057825:0:13137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789185671.057834:0:13137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272bbdc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185671.057841:0:13137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272bbdc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185671.057847:0:13137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272bbdc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185671.057853:0:13137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272bbdc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185671.057947:0:13137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789185671.057954:0:13137:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789185671.057977:0:13137:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789185671.057982:0:13137:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789185671.057987:0:13137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789185671.057993:0:13137:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789185671.057998:0:13137:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9c79072319c0) has no exports 00000020:00080000:2.0:1789185671.058023:0:13137:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9c79072319c0) has no exports 00000100:00080000:0.0:1789185671.058561:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8ad68fcc-785c-4134-99e9-eee8a8012753->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789185671.058567:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789185671.058571:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7904f01800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185671.058579:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 358 00000100:00080000:0.0:1789185671.058584:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.154@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789185671.058597:0:36:0:(import.c:666:import_select_connection()) MGC192.168.202.154@tcp: import ffff9c7904f01800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:0.0:1789185671.058629:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7936b5e300 x1876096821841664/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789185671.058707:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185671.058720:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821841792:0@lo:400:kworker.0 00000400:00000100:0.0:1789185671.058771:0:3278:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096821841792 offset 0 length 224: 4 00000100:00100000:0.0:1789185671.058828:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8ad68fcc-785c-4134-99e9-eee8a8012753:3277:1876096821841664:0@lo:250:kworker.0 00000400:00000100:0.0:1789185671.058846:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876096821841664 offset 0 length 520: 4 00000020:01000000:2.0:1789185671.061906:0:13137:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c79365c41e0 - data ffff9c793f950000/ffff9c7802788c00 00000020:01000000:2.0:1789185671.062062:0:13137:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c79073528a0 - data ffff9c792a7b3360/ffff9c793f295c00 00010000:00010000:1.0:1789185671.062721:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789185671.062733:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b9a5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185671.062745:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c794216c400 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:1.0:1789185671.062750:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b9a5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185671.062760:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x532743011272b9a5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185671.062785:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x532743011272b9a5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185671.062791:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789185671.062793:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789185671.062797:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789185671.062813:0:5812:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7904f01800 00010000:00010000:1.0:1789185671.062817:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x532743011272b9a5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185671.062823:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c794216c400/0x532743011272b99e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x532743011272b9a5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185671.062836:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185671.062840:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272bbdc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185671.062846:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d200 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:1.0:1789185671.062848:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272bbdc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185671.062854:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x532743011272bbdc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185671.062861:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x532743011272bbdc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185671.062865:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789185671.062868:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789185671.062875:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789185671.062882:0:5812:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7904f01800 00010000:00010000:1.0:1789185671.062885:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x532743011272bbdc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185671.062891:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7936b4d200/0x532743011272bbd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x532743011272bbdc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185671.062899:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185671.062901:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185671.062903:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185671.062995:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789185671.093934:0:13137:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789185671.132860:0:13137:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b7ad 00000020:00000080:2.0:1789185671.132874:0:13137:0:(genops.c:885:class_export_put()) final put ffff9c793f2df000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789185671.132897:0:13137:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c791f9b0000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789185671.132902:0:13137:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c791f9b0000 2 00000020:01000004:2.0:1789185671.132906:0:13137:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c791f9b0000 from lustre-OST0000 00000020:00000080:3.0:1789185671.132909:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c793f2df000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789185671.132963:0:13137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789185671.132976:0:13137:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789185671.132980:0:13137:0:(genops.c:885:class_export_put()) final put ffff9c793f2dc000/lustre-OST0000_UUID 00000020:00000080:2.0:1789185671.132982:0:13137:0:(genops.c:844:class_export_destroy()) destroying export ffff9c793f2dc000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789185671.132989:0:13137:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789185671.133040:0:13137:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789185671.133044:0:13137:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789185671.133048:0:13137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789185671.133054:0:13137:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789185671.133062:0:13137:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c793f2de000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789185671.133068:0:13137:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9c790661cd40) has exports, disconnecting them 00000020:00080000:2.0:1789185671.133073:0:13137:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c793f2de000), last request at 1789185440 00000020:00000080:2.0:1789185671.133077:0:13137:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b7d7 00000020:00080000:2.0:1789185671.133086:0:13137:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c793f2de000): rc 0 00000020:00000080:2.0:1789185671.133090:0:13137:0:(genops.c:885:class_export_put()) final put ffff9c793f2de000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789185671.133827:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c793f2de000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789185671.134669:0:13137:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789185671.134675:0:13137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789185671.134680:0:13137:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789185671.134686:0:13137:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789185671.134865:0:13137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789185671.134873:0:13137:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1789185671.134879:0:13137:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c791f9b0000 1 00000020:00000080:3.0:1789185671.134885:0:13137:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b767 00000020:00000080:3.0:1789185671.134892:0:13137:0:(genops.c:885:class_export_put()) final put ffff9c792fe6d800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789185671.134898:0:13137:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789185671.134910:0:13137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789185671.134915:0:13137:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789185671.134918:0:13137:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9c792f803380) has no exports 00000020:00000080:0.0:1789185671.135116:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7936dc8800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789185671.135124:0:36:0:(genops.c:885:class_export_put()) final put ffff9c793f2ba000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789185671.135127:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c793f2ba000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789185671.135132:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789185671.135206:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c792fe6d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789185671.175815:0:13137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185671.175831:0:13137:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789185671.175837:0:13137:0:(genops.c:885:class_export_put()) final put ffff9c791f9b4000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789185671.175842:0:13137:0:(genops.c:844:class_export_destroy()) destroying export ffff9c791f9b4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789185671.175852:0:13137:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789185671.177192:0:13137:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c791f9b5800 00000020:02000400:0.0:1789185671.178115:0:13137:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789185671.379074:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185672.399507:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185673.435382:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789185674.145021:0:13288:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789185674.166597:0:13288:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789185674.166680:0:13288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b97b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185674.166697:0:13288:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b97b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185674.166821:0:13288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b97b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185674.166831:0:13288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b97b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185674.166960:0:13288:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789185674.166967:0:13288:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789185674.166988:0:13288:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789185674.167001:0:13288:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c793f25c380 x1876096821840896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185675 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185674.167027:0:13288:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7904d5df80 x1876096821841408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185680 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185674.167050:0:13288:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7904d5c000 x1876096821841536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185682 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185674.167062:0:13288:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7936b5ea00 x1876096821841792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185687 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185674.167101:0:13288:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789185674.167108:0:13288:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789185674.167132:0:13288:0:(import.c:65:import_set_state_nolock()) ffff9c792fae6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789185674.167226:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821841792:0@lo:400:kworker.0 00000100:00100000:2.0:1789185674.167236:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821840896:0@lo:400:kworker.0 00000100:00100000:2.0:1789185674.167270:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1876096821841536:0@lo:400:kworker.0 00000100:00100000:1.0:1789185674.167346:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821841408:0@lo:400:kworker.0 00000100:00100000:2.0:1789185674.167647:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1876096821841920:0@lo:39:umount.0 00000400:00000100:2.0:1789185674.167696:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096821841920 offset 0 length 224: 4 00010000:00010000:0.0:1789185674.167981:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185674.167990:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b97b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185674.167999:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6400 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:0.0:1789185674.168003:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b97b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185674.168012:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x532743011272b97b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185674.168021:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x532743011272b97b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185674.168027:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789185674.168030:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789185674.168033:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789185674.168048:0:5811:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7904f01800 00010000:00010000:0.0:1789185674.168053:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x532743011272b97b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185674.168060:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79234d6400/0x532743011272b974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x532743011272b97b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185674.168163:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185674.168166:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185674.168169:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185674.448205:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185675.472941:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789185676.182459:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8ad68fcc-785c-4134-99e9-eee8a8012753->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789185676.182474:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8ad68fcc-785c-4134-99e9-eee8a8012753->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789185676.497759:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185677.519847:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185678.551002:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185679.568343:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185680.592059:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789185681.301741:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8ad68fcc-785c-4134-99e9-eee8a8012753->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789185681.301757:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8ad68fcc-785c-4134-99e9-eee8a8012753->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789185681.616265:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185682.639699:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185683.663614:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185684.370186:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185674/real 1789185674] req@ffff9c793fc84380 x1876096821841920/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789185684 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185684.370228:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c793fc84380 x1876096821841920/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789185684 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789185684.370253:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c792fae6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789185684.370323:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1876096821841920:0@lo:39:umount.0 00000100:00080000:3.0:1789185684.380632:0:13288:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789185684.380648:0:13288:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789185684.380659:0:13288:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789185684.387449:0:13288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272b989 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185684.387479:0:13288:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272b989 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185684.387615:0:13288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b989 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185684.387623:0:13288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272b989 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185684.387653:0:13288:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185684.387663:0:13288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272bbce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185684.387671:0:13288:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272bbce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185684.387678:0:13288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272bbce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185684.387705:0:13288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x532743011272bbce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185684.387735:0:13288:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789185684.387742:0:13288:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789185684.387777:0:13288:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789185684.387783:0:13288:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789185684.387788:0:13288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789185684.387795:0:13288:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789185684.387802:0:13288:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9c792f8019c0) has no exports 00000020:00080000:3.0:1789185684.387837:0:13288:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9c792f8019c0) has no exports 00010000:00010000:0.0:1789185684.388091:0:11163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185684.388103:0:11163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b989 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185684.388111:0:11163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ed600 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:0.0:1789185684.388115:0:11163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272b989 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185684.388125:0:11163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x532743011272b989 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185684.388133:0:11163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x532743011272b989 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185684.388138:0:11163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789185684.388141:0:11163:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789185684.388143:0:11163:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789185684.388161:0:11163:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7904f01800 00010000:00010000:0.0:1789185684.388166:0:11163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x532743011272b989 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185684.388186:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79013ed600/0x532743011272b982 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x532743011272b989 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185684.388205:0:11163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185684.388209:0:11163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272bbce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185684.388215:0:11163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355400 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:0.0:1789185684.388218:0:11163:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x532743011272bbce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185684.388225:0:11163:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x532743011272bbce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185684.388232:0:11163:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x532743011272bbce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185684.388238:0:11163:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789185684.388240:0:11163:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789185684.388242:0:11163:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789185684.388248:0:11163:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7904f01800 00010000:00010000:0.0:1789185684.388250:0:11163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x532743011272bbce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185684.388256:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7907355400/0x532743011272bbc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x532743011272bbce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185684.388271:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185684.388272:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185684.388280:0:11163:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185684.395580:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789185684.396770:0:13288:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c79365c44e0 - data ffff9c793f909870/ffff9c79072fd400 00000020:01000000:2.0:1789185684.396984:0:13288:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c790818cde0 - data ffff9c792a578af8/ffff9c792faabc00 00100000:10000000:2.0:1789185684.414807:0:13288:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789185684.456085:0:13288:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b878 00000020:00000080:3.0:1789185684.456102:0:13288:0:(genops.c:885:class_export_put()) final put ffff9c794102a000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789185684.456128:0:13288:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c793f2ba800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789185684.456133:0:13288:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c793f2ba800 2 00000020:01000004:3.0:1789185684.456137:0:13288:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c793f2ba800 from lustre-OST0001 00000020:00000080:3.0:1789185684.456169:0:13288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789185684.456184:0:13288:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789185684.456188:0:13288:0:(genops.c:885:class_export_put()) final put ffff9c794102b800/lustre-OST0001_UUID 00000020:00000080:3.0:1789185684.456192:0:13288:0:(genops.c:844:class_export_destroy()) destroying export ffff9c794102b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789185684.456202:0:13288:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789185684.456451:0:13288:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8ad68fcc-785c-4134-99e9-eee8a8012753->MGS 00010000:00010000:3.0:1789185684.456481:0:13288:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79234d7400/0x532743011272b78a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x532743011272b791 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185684.456497:0:13288:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79234d7400/0x532743011272b78a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x532743011272b791 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185684.456506:0:13288:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789185684.456509:0:13288:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789185684.456528:0:13288:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789185684.456548:0:13288:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7904f01800 00010000:00010000:3.0:1789185684.456554:0:13288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79234d7400/0x532743011272b78a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x532743011272b791 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185684.456572:0:13288:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c794216d400/0x532743011272b9c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x532743011272b9cf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185684.456580:0:13288:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c794216d400/0x532743011272b9c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x532743011272b9cf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185684.456586:0:13288:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789185684.456588:0:13288:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789185684.456590:0:13288:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789185684.456605:0:13288:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7904f01800 00000020:00000080:0.0:1789185684.456725:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c794102a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:3.0:1789185684.458001:0:13288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c794216d400/0x532743011272b9c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x532743011272b9cf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789185684.458053:0:13288:0:(import.c:65:import_set_state_nolock()) ffff9c7904f01800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789185684.458059:0:13288:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789185684.458063:0:13288:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789185684.458065:0:13288:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789185684.458073:0:13288:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789185684.458089:0:13288:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7936b5e300 x1876096821841664/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789185686 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789185684.458114:0:13288:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789185684.458118:0:13288:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:0.0:1789185684.458207:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8ad68fcc-785c-4134-99e9-eee8a8012753:3277:1876096821841664:0@lo:250:kworker.0 10000000:01000000:3.0:1789185684.459639:0:13288:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789185684.459664:0:13288:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b66b 00000020:00000080:3.0:1789185684.459680:0:13288:0:(genops.c:885:class_export_put()) final put ffff9c791f9b5000/8ad68fcc-785c-4134-99e9-eee8a8012753 00000020:01000000:3.0:1789185684.459706:0:13288:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.154@tcp (flags='') 00000020:00000080:3.0:1789185684.459720:0:13288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789185684.459751:0:13288:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.154@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789185684.459757:0:13288:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9c7907233380) has no exports 00000020:00000080:0.0:1789185684.459879:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c791f9b5000/8ad68fcc-785c-4134-99e9-eee8a8012753 for MGC192.168.202.154@tcp 10000000:01000000:1.0:1789185684.459946:0:5820:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789185684.460092:0:13288:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.154@tcp: client import never connected 00000100:00080000:3.0:1789185684.460097:0:13288:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789185684.460100:0:13288:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789185684.460103:0:13288:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789185684.460106:0:13288:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789185684.460200:0:13288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789185684.460210:0:13288:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.154@tcp (uuid 8ad68fcc-785c-4134-99e9-eee8a8012753) 00000020:01000000:3.0:1789185684.460218:0:13288:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789185684.460222:0:13288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789185684.460226:0:13288:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789185684.460233:0:13288:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c792fae0800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789185684.460239:0:13288:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9c792fab99c0) has exports, disconnecting them 00000020:00080000:3.0:1789185684.460245:0:13288:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c792fae0800), last request at 1789185461 00000020:00000080:3.0:1789185684.460251:0:13288:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b8a2 00000020:00080000:3.0:1789185684.460265:0:13288:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c792fae0800): rc 0 00000020:00000080:3.0:1789185684.460269:0:13288:0:(genops.c:885:class_export_put()) final put ffff9c792fae0800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789185684.469218:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7904f01800 for MGC192.168.202.154@tcp 00000020:00000080:0.0:1789185684.469248:0:36:0:(genops.c:885:class_export_put()) final put ffff9c7904f02800/8ad68fcc-785c-4134-99e9-eee8a8012753 00000020:00000080:0.0:1789185684.469253:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7904f02800/8ad68fcc-785c-4134-99e9-eee8a8012753 for MGC192.168.202.154@tcp 00000020:01000000:0.0:1789185684.469264:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.154@tcp (8ad68fcc-785c-4134-99e9-eee8a8012753) 00000020:00000080:0.0:1789185684.471749:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c792fae0800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789185684.477508:0:13288:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789185684.477520:0:13288:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789185684.477526:0:13288:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789185684.477537:0:13288:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789185684.477641:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789185684.477795:0:11163:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789185684.478178:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000020:00000080:1.0:1789185684.478264:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c792fae6800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:1.0:1789185684.478402:0:5807:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c7907d58600:5807] 1 exiting: rc = 0 00000100:00100000:2.0:1789185684.478696:0:5806:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c7910e50000:5806] 0 exiting: rc = 1 00000100:00100000:0.0:1789185684.480304:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.480914:0:5808:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c7907d58000:5808] 0 exiting: rc = 1 00000100:00100000:1.0:1789185684.481060:0:5809:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c7911be5600:5809] 1 exiting: rc = 0 00000100:00100000:2.0:1789185684.483316:0:5810:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c7905ba6e00:5810] 2 exiting: rc = 0 00000100:00100000:3.0:1789185684.493997:0:6692:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c793f2a0e00:6692] 3 exiting: rc = 0 00000100:00100000:0.0:1789185684.494298:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494326:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494335:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494342:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494348:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494355:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494364:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494370:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494377:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494385:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494391:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494398:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494438:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494446:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494467:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494474:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494482:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494488:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494494:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494500:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494507:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494512:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494517:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494523:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494529:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494536:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494543:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494549:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494555:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494561:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494565:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494570:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494576:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494581:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494586:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494591:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494596:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494601:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494606:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494792:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494797:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494802:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494807:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494813:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494827:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494834:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494841:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494847:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494853:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494866:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494871:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494877:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494883:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494888:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494895:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494900:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494906:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494913:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494918:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494923:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494928:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494934:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494939:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.494945:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789185684.496971:0:13288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185684.497000:0:13288:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789185684.497009:0:13288:0:(genops.c:885:class_export_put()) final put ffff9c792fae0000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789185684.497015:0:13288:0:(genops.c:844:class_export_destroy()) destroying export ffff9c792fae0000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789185684.497022:0:13288:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1789185684.497081:0:13288:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c793f2ba800 1 00000020:00000080:1.0:1789185684.497090:0:13288:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x532743011272b847 00000020:00000080:1.0:1789185684.497099:0:13288:0:(genops.c:885:class_export_put()) final put ffff9c794102f000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789185684.497156:0:13288:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789185684.497162:0:13288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185684.497167:0:13288:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789185684.497172:0:13288:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9c7907234d40) has no exports 00000020:00000080:3.0:1789185684.497272:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c794102f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789185684.529088:0:13288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185684.529113:0:13288:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789185684.529122:0:13288:0:(genops.c:885:class_export_put()) final put ffff9c793f2bc000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789185684.529128:0:13288:0:(genops.c:844:class_export_destroy()) destroying export ffff9c793f2bc000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789185684.529145:0:13288:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789185684.529481:0:13288:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c793f2bd800 00000020:01000000:0.0:1789185684.529511:0:13288:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789185684.529517:0:13288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789185684.529522:0:13288:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789185684.529529:0:13288:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9c7936dd3380) has no exports 00000020:00000080:0.0:1789185684.529563:0:13288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185684.529571:0:13288:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789185684.529574:0:13288:0:(genops.c:885:class_export_put()) final put ffff9c792fe6d000/OSS_uuid 00000020:00000080:0.0:1789185684.529577:0:13288:0:(genops.c:844:class_export_destroy()) destroying export ffff9c792fe6d000/OSS_uuid for OSS 00000020:01000000:0.0:1789185684.529582:0:13288:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1789185684.529798:0:5818:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789185684.530052:0:6679:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9c7940bccc00:6679] 2 exiting: rc = 0 00000100:00100000:0.0:1789185684.530126:0:6678:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9c7936962a00:6678] 1 exiting: rc = 0 00000100:00100000:0.0:1789185684.530197:0:12523:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff9c7904f85000:12523] 4 exiting: rc = 0 00000100:00100000:0.0:1789185684.530303:0:6884:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9c793f6fae00:6884] 3 exiting: rc = 0 00000100:00100000:1.0:1789185684.532038:0:6676:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9c7936963400:6676] 0 exiting: rc = 1 00000100:00100000:0.0:1789185684.532267:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532291:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532299:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532307:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532314:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532320:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532326:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532331:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532337:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532483:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532492:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532499:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532506:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532512:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532518:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532523:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532529:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532536:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532543:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532548:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532554:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532560:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532565:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532571:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532576:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532582:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532589:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532597:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532603:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532675:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532682:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532688:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532694:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532700:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532723:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532729:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532734:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532740:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532745:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532751:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532757:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532763:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532768:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532773:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532778:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532784:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532792:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532797:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532802:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532808:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532813:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532819:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532824:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532829:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532835:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532840:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532846:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532851:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532858:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532863:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532868:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532874:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532879:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.532885:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.537367:0:8180:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9c792ff49600:8180] 2 exiting: rc = 0 00000100:00100000:0.0:1789185684.537635:0:6681:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c791033c000:6681] 1 exiting: rc = 0 00000100:00100000:0.0:1789185684.538504:0:6680:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c7936903e00:6680] 0 exiting: rc = 1 00000100:00100000:1.0:1789185684.538664:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538676:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538682:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538688:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538693:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538699:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538705:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538710:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538717:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538723:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538729:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538737:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538743:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538749:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538755:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538761:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538786:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538792:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538798:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538803:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538809:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.538815:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539312:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539322:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539328:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539333:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539339:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539346:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539352:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539358:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539364:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539369:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539374:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539379:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539385:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539391:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539397:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539402:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539442:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539448:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539453:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539458:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539464:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539471:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539476:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539481:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539486:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539491:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539497:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539502:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539508:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539527:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539533:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539540:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539545:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539551:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539557:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539563:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539570:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539578:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539585:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539591:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539597:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.539668:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.543212:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c791033c400:6684] 2 exiting: rc = 0 00000100:00100000:0.0:1789185684.543545:0:6683:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c7936902a00:6683] 1 exiting: rc = 0 00000100:00100000:1.0:1789185684.544069:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c7936903600:6682] 0 exiting: rc = 1 00000100:00100000:1.0:1789185684.544152:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544163:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544169:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544176:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544183:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544202:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544210:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544217:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544223:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544233:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544240:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544246:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544256:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544262:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544269:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544278:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544284:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544290:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544297:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544304:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544311:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544328:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544335:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544341:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544347:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544354:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544363:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544370:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544376:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544399:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544434:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544441:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544448:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544454:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544460:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544466:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544473:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544480:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544487:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544492:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544498:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544505:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544512:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544518:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544524:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544531:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544537:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544543:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544550:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544556:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544562:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544569:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544575:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544582:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544588:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544595:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544630:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544638:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544644:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544650:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544657:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544665:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544671:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.544678:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185684.555788:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c791033c600:6685] 0 exiting: rc = 1 00000100:00100000:3.0:1789185684.556010:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c791033cc00:6686] 1 exiting: rc = 0 00000100:00100000:0.0:1789185684.556135:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556144:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556150:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556156:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556162:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556169:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556175:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556181:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556187:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556192:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556197:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556203:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556208:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556213:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556219:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556224:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556229:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556234:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556240:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556245:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556251:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556259:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556265:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556270:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556276:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556281:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556286:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556292:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556297:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556302:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556308:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556313:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556320:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556325:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556331:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556357:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556363:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556370:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556377:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556382:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556387:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556393:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556399:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556517:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556525:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556531:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556537:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556543:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556550:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556556:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556563:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556568:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556574:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556579:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556586:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556592:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556598:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556606:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556684:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556692:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556697:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556703:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556708:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.556714:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185684.558067:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c7910398c00:6687] 0 exiting: rc = 1 00000100:00100000:1.0:1789185684.558199:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c7910399e00:6688] 1 exiting: rc = 0 00000100:00100000:0.0:1789185684.558346:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558355:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558362:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558369:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558377:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558385:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558537:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558547:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558557:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558564:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558570:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558580:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558604:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558684:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558691:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558698:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558706:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558712:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558719:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558734:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558742:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558748:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.558757:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559153:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559236:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559245:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559256:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559262:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559273:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559282:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559293:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559301:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559308:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559320:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559327:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559334:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559361:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559369:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559377:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559384:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559391:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559505:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559513:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559520:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559528:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559534:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559541:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559548:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559572:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559580:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559588:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559596:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559603:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559687:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559695:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559704:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559712:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559719:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559726:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559733:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559756:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559765:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559772:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185684.559779:0:13288:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789185684.570990:0:13288:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789185703.668282:0:13908:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789185712.972497:0:14368:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789185712.972502:0:14368:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789185712.972617:0:14368:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c793f283000 00000020:01000004:3.0:1789185712.972634:0:14368:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789185712.972642:0:14368:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789185712.972658:0:14368:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c7936dd3380) 00000020:00000080:3.0:1789185712.972675:0:14368:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789185712.992226:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789185712.994862:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1789185712.995225:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1789185712.995744:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1789185712.995849:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1789185712.995950:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:3.0:1789185712.996153:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789185712.996225:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:3.0:1789185712.996327:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:3.0:1789185712.996823:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:3.0:1789185712.998176:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 397: rc = 0 00100000:10000000:3.0:1789185712.998285:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 397: rc = 0 00100000:10000000:3.0:1789185712.999195:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1789185712.999760:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:3.0:1789185713.000038:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:3.0:1789185713.000298:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1789185713.000804:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1789185713.001060:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:3.0:1789185713.001317:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1789185713.001864:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:3.0:1789185713.002122:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1789185713.002688:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1789185713.002973:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:3.0:1789185713.003224:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:3.0:1789185713.003923:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 414: rc = 0 00100000:10000000:3.0:1789185713.004197:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 414: rc = 0 00100000:10000000:3.0:1789185713.004683:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 414: rc = 0 00100000:10000000:3.0:1789185713.004956:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 414: rc = 0 00100000:10000000:3.0:1789185713.005197:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 414: rc = 0 00100000:10000000:3.0:1789185713.005697:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 414: rc = 0 00100000:10000000:3.0:1789185713.005943:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 414: rc = 0 00100000:10000000:3.0:1789185713.006165:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 414: rc = 0 00100000:10000000:3.0:1789185713.006690:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 414: rc = 0 00100000:10000000:3.0:1789185713.006994:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 414: rc = 0 00100000:10000000:3.0:1789185713.007207:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 414: rc = 0 00100000:10000000:3.0:1789185713.007674:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 414: rc = 0 00100000:10000000:3.0:1789185713.007933:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 414: rc = 0 00100000:10000000:3.0:1789185713.008205:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 414: rc = 0 00100000:10000000:3.0:1789185713.008731:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 414: rc = 0 00100000:10000000:3.0:1789185713.008985:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 414: rc = 0 00100000:10000000:3.0:1789185713.009339:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 414: rc = 0 00100000:10000000:3.0:1789185713.009705:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 414: rc = 0 00100000:10000000:3.0:1789185713.009978:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 414: rc = 0 00100000:10000000:3.0:1789185713.010238:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 414: rc = 0 00100000:10000000:3.0:1789185713.010975:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 414: rc = 0 00100000:10000000:3.0:1789185713.011265:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 414: rc = 0 00100000:10000000:3.0:1789185713.011782:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 414: rc = 0 00100000:10000000:3.0:1789185713.012035:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 414: rc = 0 00100000:10000000:3.0:1789185713.012290:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 414: rc = 0 00100000:10000000:3.0:1789185713.012801:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 414: rc = 0 00100000:10000000:3.0:1789185713.013054:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 414: rc = 0 00100000:10000000:3.0:1789185713.013311:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 414: rc = 0 00100000:10000000:3.0:1789185713.013850:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 414: rc = 0 00100000:10000000:3.0:1789185713.014174:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 414: rc = 0 00100000:10000000:3.0:1789185713.014782:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 414: rc = 0 00100000:10000000:3.0:1789185713.015080:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 414: rc = 0 00100000:10000000:3.0:1789185713.015753:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 777: rc = 0 00100000:10000000:3.0:1789185713.016269:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789185713.016635:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 398: rc = 0 00100000:10000000:3.0:1789185713.016850:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789185713.016923:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 398: rc = 0 00100000:10000000:3.0:1789185713.017129:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789185713.017202:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 398: rc = 0 00100000:10000000:3.0:1789185713.018199:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789185713.018283:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 718: rc = 0 00100000:10000000:3.0:1789185713.018838:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789185713.019052:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 718: rc = 0 00100000:10000000:3.0:1789185713.019253:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789185713.019328:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 718: rc = 0 00000020:00000080:3.0:1789185713.019845:0:14368:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789185713.019854:0:14368:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789185713.019866:0:14368:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x532743011272c95e 00000020:01000004:3.0:1789185713.019876:0:14368:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789185713.019882:0:14368:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789185713.019888:0:14368:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c793f283000 from MGS 00000020:01000004:3.0:1789185713.019892:0:14368:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789185713.019903:0:14368:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c7936dd4d40) 00000020:00000080:3.0:1789185713.019913:0:14368:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789185713.019972:0:14368:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c793f283000 from MGS, refs=2 00080000:01000000:3.0:1789185713.019978:0:14368:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789185713.019984:0:14368:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x532743011272c96c 00000100:00100000:3.0:1789185713.020096:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789185713.020237:0:14368:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789185713.020244:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789185713.021020:0:14368:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789185713.021029:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789185713.021935:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789185713.022128:0:14368:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789185713.022135:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789185713.022866:0:14368:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789185713.022874:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789185713.023265:0:14368:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789185713.023272:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789185713.024220:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185713.024231:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185713.024233:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185713.032686:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185713.032693:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185713.032696:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185713.035093:0:14368:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789185713.040955:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789185713.059083:0:14368:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789185713.059103:0:14368:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789185713.059105:0:14368:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789185713.065010:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789185713.065286:0:14368:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789185713.065579:0:14368:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789185713.066092:0:14368:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789185713.070605:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789185713.070799:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789185713.070807:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789185713.079767:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789185713.079783:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789185713.082384:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789185713.082401:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1789185713.083300:0:14382:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1789185713.083648:0:14368:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789185713.083686:0:14368:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.154@tcp' 00000020:01000004:2.0:1789185713.083688:0:14368:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789185713.083729:0:14368:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.154@tcp (typ=mgc) 00000020:00000080:2.0:1789185713.083744:0:14368:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.154@tcp (ffff9c792f804d40) 00000020:00000080:2.0:1789185713.083761:0:14368:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789185713.083842:0:14368:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7803249000@MGC192.168.202.154@tcp: add connection 192.168.202.154@tcp at head 00010000:00010000:2.0:1789185713.083993:0:14368:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.154@tcp-0 is initialized 00000040:01000000:2.0:1789185713.084000:0:14368:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789185713.087106:0:14383:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789185713.093078:0:14368:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.154@tcp (uuid 58cff117-25e2-45dd-b12f-8a52f6f341b2) 00000020:00000080:3.0:1789185713.093169:0:14368:0:(genops.c:1384:class_connect()) connect: client 58cff117-25e2-45dd-b12f-8a52f6f341b2, cookie 0x532743011272c97a 00000100:00080000:3.0:1789185713.093185:0:14368:0:(import.c:545:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789185713.093198:0:14368:0:(import.c:666:import_select_connection()) MGC192.168.202.154@tcp: import ffff9c7803249000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789185713.093233:0:14368:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c793fc86680 x1876096821842048/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789185713.093263:0:14368:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 58cff117-25e2-45dd-b12f-8a52f6f341b2->MGS 00000020:01000004:3.0:1789185713.093286:0:14368:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789185713.093291:0:14368:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789185713.093305:0:14368:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c7936dd0000) 00000020:00000080:3.0:1789185713.093316:0:14368:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789185713.093455:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:58cff117-25e2-45dd-b12f-8a52f6f341b2:3277:1876096821842048:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789185713.093522:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185713.093599:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821842048 00000100:00100000:1.0:1789185713.093607:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821842048 00000100:00100000:1.0:1789185713.093641:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185713.093649:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1876096821842048:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789185713.093758:0:14379:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 58cff117-25e2-45dd-b12f-8a52f6f341b2@0@lo t0 exp 0000000000000000 cur 410 last 0 00000020:00000080:1.0:1789185713.093781:0:14379:0:(genops.c:1384:class_connect()) connect: client 58cff117-25e2-45dd-b12f-8a52f6f341b2, cookie 0x532743011272c988 00000100:00080000:1.0:1789185713.093897:0:14379:0:(import.c:65:import_set_state_nolock()) ffff9c7904fc6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185713.093956:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+5:3277:x1876096821842048:12345-0@lo:250:mount.lustre.0 Request processed in 304us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185713.093977:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185713.094041:0:3277:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789185713.094050:0:3277:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.154@tcp: connect to target with instance 0 00000100:00080000:1.0:1789185713.094059:0:3277:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789185713.094063:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789185713.094068:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c7803249000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789185713.094070:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789185713.094083:0:3277:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789185713.094088:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:58cff117-25e2-45dd-b12f-8a52f6f341b2:3277:1876096821842048:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789185713.116693:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185713.116989:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789185713.116997:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789185713.118599:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789185713.118611:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789185713.119811:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789185713.119820:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789185713.122435:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185713.122610:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789185713.122618:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789185713.123048:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789185713.123055:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789185713.220843:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185713.224851:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789185713.224861:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789185713.227684:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789185713.227697:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789185713.233643:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185713.233999:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789185713.234004:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789185713.234928:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789185713.234948:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789185713.236389:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185713.236624:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789185713.236630:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789185713.237867:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789185713.237877:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789185713.239149:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185713.239334:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789185713.239340:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789185713.245648:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789185713.245744:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789185713.283130:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185713.283334:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789185713.283341:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789185713.285571:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789185713.285585:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789185713.293924:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789185713.295739:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789185713.296622:0:14368:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789185713.296648:0:14368:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789185713.296655:0:14368:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789185713.296794:0:14368:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789185713.296829:0:14368:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.154@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789185713.296833:0:14368:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789185713.296835:0:14368:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789185713.296836:0:14368:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185713.296838:0:14368:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185713.296839:0:14368:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185713.296840:0:14368:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185713.296841:0:14368:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789185713.296843:0:14368:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789185713.296845:0:14368:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185713.296846:0:14368:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789185713.296849:0:14368:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789185713.296851:0:14368:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789185713.296852:0:14368:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789185713.296853:0:14368:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185713.296854:0:14368:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185713.296855:0:14368:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185713.296856:0:14368:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185713.296857:0:14368:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789185713.296858:0:14368:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789185713.296859:0:14368:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185713.296860:0:14368:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789185713.296889:0:14368:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789185713.296913:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821842176:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789185713.297005:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185713.297066:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906bef600 going to sleep for 11 seconds 00000100:00100000:2.0:1789185713.297189:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821842176 00000100:00100000:2.0:1789185713.297197:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821842176 00000100:00100000:2.0:1789185713.297246:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789185713.297256:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+5:14368:x1876096821842176:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789185713.297306:0:14381:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789185713.297309:0:14381:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789185713.297312:0:14381:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789185713.301334:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789185713.301974:0:14381:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1789185713.304325:0:14403:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789185713.304334:0:14403:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789185713.304337:0:14403:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789185713.304373:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789185713.308038:0:14381:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789185713.308063:0:14381:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789185713.339942:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+5:14368:x1876096821842176:12345-0@lo:253:mount.lustre.0 Request processed in 42677us (42925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185713.339963:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185713.340086:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821842176:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789185713.340100:0:14368:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789185713.340104:0:14368:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789185713.340105:0:14368:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789185713.340107:0:14368:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185713.340108:0:14368:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185713.340109:0:14368:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185713.340110:0:14368:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185713.340111:0:14368:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789185713.340112:0:14368:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789185713.340114:0:14368:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185713.340115:0:14368:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789185713.340132:0:14368:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c793f283000 from lustre-MDT0000 10000000:01000000:3.0:1789185713.340156:0:14368:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789185713.340159:0:14368:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789185713.340163:0:14368:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c792f804d40 10000000:01000000:3.0:1789185713.340167:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789185713.340175:0:14368:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c792f804d40 from 1 10000000:01000000:3.0:1789185713.340178:0:14368:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789185713.340213:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272c98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.340223:0:14368:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272c98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.340232:0:14368:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272c98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185713.340251:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821842304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789185713.340302:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185713.340339:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906befa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789185713.340402:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821842304 00000100:00100000:1.0:1789185713.340456:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821842304 00000100:00100000:1.0:1789185713.340497:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789185713.340506:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+5:14368:x1876096821842304:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185713.340518:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185713.340531:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7936b4cc00/0x532743011272c996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272c98f expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185713.340555:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7936b4cc00/0x532743011272c996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272c98f expref: 6 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185713.340566:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7936b4cc00/0x532743011272c996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272c98f expref: 6 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185713.340577:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4cc00, rc 0) 00000100:00100000:1.0:1789185713.340623:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+6:14368:x1876096821842304:12345-0@lo:101:mount.lustre.0 Request processed in 117us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185713.340637:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185713.340831:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821842304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789185713.340851:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272c98f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272c996 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185713.340860:0:14368:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272c98f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272c996 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185713.340911:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821842432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185713.340937:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185713.340954:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7911885d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789185713.341525:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821842432 00000100:00100000:0.0:1789185713.341532:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821842432 00000100:00100000:0.0:1789185713.341572:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789185713.341581:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79188bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+6:14368:x1876096821842432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185713.341851:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79188bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+6:14368:x1876096821842432:12345-0@lo:501:mount.lustre.0 Request processed in 271us (913us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789185713.341859:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789185713.341991:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821842432:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789185713.342028:0:14368:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789185713.342047:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272c98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272c996 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185713.342057:0:14368:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272c98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272c996 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185713.342065:0:14368:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c793f283000 10000000:01000000:2.0:1789185713.342070:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789185713.342074:0:14368:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c793f283000 10000000:01000000:2.0:1789185713.342076:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789185713.342079:0:14368:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c793f283000 from 1 10000000:01000000:2.0:1789185713.342081:0:14368:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789185713.342104:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79073ffa00/0x532743011272c99d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185713.342111:0:14368:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79073ffa00/0x532743011272c99d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185713.342131:0:14368:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79073ffa00/0x532743011272c99d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185713.342145:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821842560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789185713.342171:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185713.342203:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7911885d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185713.342273:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821842560 00000100:00100000:3.0:1789185713.342278:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821842560 00000100:00100000:3.0:1789185713.342315:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789185713.342323:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79188ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+6:14368:x1876096821842560:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185713.342331:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185713.342345:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe05600/0x532743011272c9a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272c99d expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.342364:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe05600/0x532743011272c9a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272c99d expref: 7 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.342374:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe05600/0x532743011272c9a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272c99d expref: 7 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.342382:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05600, rc 0) 00000100:00100000:3.0:1789185713.342456:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79188ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+7:14368:x1876096821842560:12345-0@lo:101:mount.lustre.0 Request processed in 134us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185713.342462:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789185713.342621:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821842560:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789185713.342633:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79073ffa00/0x532743011272c99d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272c9a4 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185713.342641:0:14368:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79073ffa00/0x532743011272c99d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272c9a4 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185713.342668:0:14368:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789185713.342673:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79073ffa00/0x532743011272c99d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272c9a4 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185713.342681:0:14368:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79073ffa00/0x532743011272c99d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272c9a4 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185713.342687:0:14368:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789185713.342691:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789185713.342695:0:14368:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c793f283000 10000000:01000000:2.0:1789185713.342698:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789185713.342701:0:14368:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789185713.342703:0:14368:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789185713.342733:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79073fea00/0x532743011272c9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185713.342747:0:14368:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79073fea00/0x532743011272c9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185713.342754:0:14368:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79073fea00/0x532743011272c9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185713.342766:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821842688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789185713.342792:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185713.342819:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7911885d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789185713.342887:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821842688 00000100:00100000:1.0:1789185713.342891:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821842688 00000100:00100000:1.0:1789185713.342925:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185713.342933:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79188b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+7:14368:x1876096821842688:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185713.342941:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185713.342951:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7936b4d800/0x532743011272c9b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272c9ab expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185713.342966:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7936b4d800/0x532743011272c9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272c9ab expref: 8 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185713.342976:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7936b4d800/0x532743011272c9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272c9ab expref: 8 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185713.342983:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4d800, rc 0) 00000100:00100000:1.0:1789185713.343012:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79188b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+8:14368:x1876096821842688:12345-0@lo:101:mount.lustre.0 Request processed in 81us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185713.343018:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789185713.343791:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821842688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789185713.343808:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79073fea00/0x532743011272c9ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272c9b2 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185713.343841:0:14368:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79073fea00/0x532743011272c9ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272c9b2 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185713.344010:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821842816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185713.344051:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185713.344091:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7911885d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185713.344172:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821842816 00000100:00100000:3.0:1789185713.344178:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821842816 00000100:00100000:3.0:1789185713.344216:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789185713.344224:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79188bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+8:14368:x1876096821842816:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185713.344645:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79188bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+9:14368:x1876096821842816:12345-0@lo:501:mount.lustre.0 Request processed in 421us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185713.344653:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789185713.344995:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821842816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185713.345034:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821842944:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789185713.345081:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185713.345114:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7911885d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789185713.346587:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821842944 00000100:00100000:1.0:1789185713.346602:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821842944 00000100:00100000:1.0:1789185713.346673:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185713.346685:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79188bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+9:14368:x1876096821842944:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789185713.347104:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79188bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+9:14368:x1876096821842944:12345-0@lo:503:mount.lustre.0 Request processed in 421us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185713.347113:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789185713.347262:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821842944:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789185713.347970:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58cff117-25e2-45dd-b12f-8a52f6f341b2:14404:1876096821843072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185713.348030:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185713.348078:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7940bdbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185713.348138:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821843072 00000100:00100000:1.0:1789185713.348151:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821843072 00000100:00100000:1.0:1789185713.348192:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789185713.348200:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f658850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+9:14404:x1876096821843072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185713.352164:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f658850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+9:14404:x1876096821843072:12345-0@lo:502:llog_process_th.0 Request processed in 3955us (4123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185713.352181:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789185713.352455:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58cff117-25e2-45dd-b12f-8a52f6f341b2:14404:1876096821843072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185713.352494:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185713.352507:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185713.352510:0:14404:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789185713.352516:0:14404:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789185713.352519:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789185713.352538:0:14404:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c792f8019c0) 00000020:00000080:2.0:1789185713.352558:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789185713.352565:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789185713.352649:0:14404:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789185713.352659:0:14404:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x532743011272c9c0 00000020:00000080:2.0:1789185713.352905:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789185713.352910:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185713.352914:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185713.352916:0:14404:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789185713.352919:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185713.352923:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185713.352924:0:14404:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789185713.352928:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789185713.352937:0:14404:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c792f803380) 00000020:00000080:2.0:1789185713.352947:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789185713.352952:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789185713.352954:0:14404:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789185713.352957:0:14404:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789185713.352963:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789185713.353028:0:14404:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c793f283000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789185713.353043:0:14404:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c792f800000) 00000020:00000080:2.0:1789185713.353051:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789185713.353106:0:14404:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789185713.353112:0:14404:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x532743011272c9d5 00000020:00000080:2.0:1789185713.353209:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789185713.353222:0:14404:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789185713.353228:0:14404:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x532743011272c9dc 00080000:01000000:2.0:1789185713.353233:0:14404:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789185713.353237:0:14404:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x532743011272c9e3 00010000:00010000:2.0:1789185713.457921:0:14404:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789185713.458570:0:14404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1789185713.458778:0:14404:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789185713.459463:0:14404:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c7907234d40) 00000020:00000080:2.0:1789185713.459485:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789185713.459554:0:14404:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789185713.459561:0:14404:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x532743011272c9f1 00000020:00000080:3.0:1789185713.465300:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789185713.475423:0:14404:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x532743011272c9f8 00000020:00000080:2.0:1789185713.476482:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789185713.476496:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185713.476648:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185713.476651:0:14404:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789185713.476656:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185713.476662:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185713.476663:0:14404:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789185713.476667:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789185713.476719:0:14404:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789185713.476732:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185713.476736:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185713.476737:0:14404:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789185713.476740:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789185713.476742:0:14404:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789185713.476744:0:14404:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789185713.476746:0:14404:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789185713.476747:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789185713.476749:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185713.476750:0:14404:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789185713.476753:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789185713.476757:0:14404:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789185713.476759:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185713.476760:0:14404:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789185713.476763:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789185713.476769:0:14404:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:3.0:1789185713.476796:0:14404:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789185713.476799:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789185713.476815:0:14404:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c7936dd19c0) 00000020:00000080:3.0:1789185713.476830:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789185713.476841:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789185713.476899:0:14404:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789185713.476905:0:14404:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789185713.476913:0:14404:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x532743011272ca06 00010000:00080000:3.0:1789185713.476947:0:14404:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c79405c4000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1789185713.477210:0:14404:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789185713.477650:0:14404:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789185713.477695:0:14404:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789185713.478610:0:14404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789185713.478678:0:14404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789185713.478772:0:14404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789185713.480339:0:14408:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789185713.480346:0:14408:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789185713.481298:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789185713.481317:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789185713.481352:0:14404:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789185713.481384:0:14404:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x532743011272ca0d 00000100:00080000:3.0:1789185713.481396:0:14404:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789185713.481537:0:14404:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c79405c4000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789185713.481582:0:14404:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c793fc87b80 x1876096821843200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789185713.481633:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821843200:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789185713.481685:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876096821843200 offset 0 length 520: 4 00000100:00080000:3.0:1789185713.481790:0:14404:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789185713.481847:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185713.481851:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185713.481853:0:14404:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789185713.481856:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789185713.481863:0:14404:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789185713.481865:0:14404:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789185713.481867:0:14404:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789185713.481869:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789185713.481871:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185713.481873:0:14404:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789185713.481875:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789185713.481879:0:14404:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789185713.481882:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185713.481884:0:14404:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789185713.481887:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789185713.481891:0:14404:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:3.0:1789185713.481916:0:14404:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789185713.481925:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789185713.481946:0:14404:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c793abd0000) 00000020:00000080:3.0:1789185713.481958:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789185713.481965:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789185713.482023:0:14404:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789185713.482029:0:14404:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789185713.482036:0:14404:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x532743011272ca1b 00010000:00080000:3.0:1789185713.482064:0:14404:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7905456800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1789185713.482284:0:14404:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789185713.482504:0:14404:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789185713.482527:0:14404:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789185713.483017:0:14404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789185713.483091:0:14404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789185713.483168:0:14404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789185713.484240:0:14410:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789185713.484247:0:14410:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789185713.486374:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789185713.486390:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789185713.486565:0:14404:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789185713.486587:0:14404:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x532743011272ca22 00000100:00080000:3.0:1789185713.486599:0:14404:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789185713.486611:0:14404:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7905456800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789185713.486651:0:14404:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c793fc86300 x1876096821843328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789185713.486720:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821843328:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789185713.486776:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876096821843328 offset 0 length 520: 4 00000100:00080000:3.0:1789185713.486834:0:14404:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789185713.486948:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185713.486953:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185713.486956:0:14404:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789185713.486959:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185713.486963:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185713.486965:0:14404:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789185713.486968:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789185713.486970:0:14404:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789185713.486983:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185713.486986:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185713.486987:0:14404:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789185713.486990:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185713.486993:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185713.486994:0:14404:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789185713.486998:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789185713.487027:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58cff117-25e2-45dd-b12f-8a52f6f341b2:14404:1876096821843456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185713.487076:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185713.487094:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7903d31480 going to sleep for 11 seconds 00000100:00100000:3.0:1789185713.487126:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821843456 00000100:00100000:3.0:1789185713.487133:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821843456 00000100:00100000:3.0:1789185713.487170:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789185713.487180:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f658050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+9:14404:x1876096821843456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185713.487432:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f658050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+9:14404:x1876096821843456:12345-0@lo:502:llog_process_th.0 Request processed in 252us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185713.487440:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789185713.487500:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58cff117-25e2-45dd-b12f-8a52f6f341b2:14404:1876096821843456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789185713.487530:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185713.487535:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185713.487536:0:14404:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789185713.487539:0:14404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789185713.487733:0:14368:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789185713.487762:0:14368:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789185713.487778:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79073fea00/0x532743011272c9ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272c9b2 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185713.487789:0:14368:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79073fea00/0x532743011272c9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272c9b2 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185713.487798:0:14368:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c793f283000 from 1 10000000:01000000:0.0:1789185713.487801:0:14368:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789185713.487829:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7907354600/0x532743011272ca29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185713.487837:0:14368:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7907354600/0x532743011272ca29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185713.487846:0:14368:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7907354600/0x532743011272ca29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185713.487859:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821843584:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789185713.487889:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185713.487920:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7910fcb000 going to sleep for 11 seconds 00000100:00100000:3.0:1789185713.488032:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821843584 00000100:00100000:3.0:1789185713.488037:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821843584 00000100:00100000:3.0:1789185713.488069:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185713.488076:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f65b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+9:14368:x1876096821843584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185713.488086:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185713.488099:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe05000/0x532743011272ca30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272ca29 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.488133:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe05000/0x532743011272ca30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272ca29 expref: 10 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.488143:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe05000/0x532743011272ca30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ca29 expref: 10 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.488152:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05000, rc 0) 00000100:00100000:3.0:1789185713.488252:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f65b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+10:14368:x1876096821843584:12345-0@lo:101:mount.lustre.0 Request processed in 175us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185713.488258:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789185713.488570:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821843584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185713.488585:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7907354600/0x532743011272ca29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ca30 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185713.488594:0:14368:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7907354600/0x532743011272ca29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272ca30 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185713.489230:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821843712:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789185713.489276:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185713.489691:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7910fcb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185713.489780:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821843712 00000100:00100000:3.0:1789185713.489787:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821843712 00000100:00100000:3.0:1789185713.489871:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185713.489881:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f659450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+10:14368:x1876096821843712:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789185713.489899:0:14379:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789185713.489905:0:14379:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789185713.490011:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f659450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+10:14368:x1876096821843712:12345-0@lo:256:mount.lustre.0 Request processed in 131us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185713.490019:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789185713.490083:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821843712:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789185713.490717:0:14368:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789185713.490737:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7907354600/0x532743011272ca29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ca30 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185713.490761:0:14368:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7907354600/0x532743011272ca29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ca30 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185713.490770:0:14368:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c793f283000 from 1 10000000:01000000:0.0:1789185713.490773:0:14368:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789185713.490800:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272ca37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185713.490808:0:14368:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272ca37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185713.490817:0:14368:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272ca37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185713.490833:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821843840:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789185713.490873:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185713.496526:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7910fcb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185713.496762:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821843840 00000100:00100000:1.0:1789185713.496771:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821843840 00000100:00100000:1.0:1789185713.496814:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789185713.496821:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f65bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+10:14368:x1876096821843840:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185713.496835:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185713.496850:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7936b4ca00/0x532743011272ca3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272ca37 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185713.496875:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7936b4ca00/0x532743011272ca3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272ca37 expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185713.496901:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7936b4ca00/0x532743011272ca3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ca37 expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185713.496909:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4ca00, rc 0) 00000100:00100000:1.0:1789185713.499837:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f65bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+11:14368:x1876096821843840:12345-0@lo:101:mount.lustre.0 Request processed in 3005us (8951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185713.499852:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789185713.500260:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821843840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185713.500286:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272ca37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ca3e expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185713.500298:0:14368:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272ca37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272ca3e expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185713.500380:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821843968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185713.500715:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185713.500779:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7910fcb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185713.500835:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821843968 00000100:00100000:3.0:1789185713.500843:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821843968 00000100:00100000:3.0:1789185713.500921:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789185713.500931:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+11:14368:x1876096821843968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185713.501316:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+11:14368:x1876096821843968:12345-0@lo:501:mount.lustre.0 Request processed in 386us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185713.501326:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789185713.501422:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821843968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185713.501475:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821844096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789185713.501516:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185713.501909:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7910fcb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185713.501988:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821844096 00000100:00100000:1.0:1789185713.501995:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821844096 00000100:00100000:1.0:1789185713.502023:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185713.502031:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f65a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+11:14368:x1876096821844096:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789185713.502249:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f65a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+11:14368:x1876096821844096:12345-0@lo:503:mount.lustre.0 Request processed in 218us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185713.502256:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789185713.502898:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821844096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789185713.503376:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58cff117-25e2-45dd-b12f-8a52f6f341b2:14412:1876096821844224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185713.503620:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185713.503684:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7903d31d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789185713.503726:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821844224 00000100:00100000:1.0:1789185713.503733:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821844224 00000100:00100000:1.0:1789185713.503808:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185713.503818:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f65ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+11:14412:x1876096821844224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185713.504064:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f65ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+11:14412:x1876096821844224:12345-0@lo:502:llog_process_th.0 Request processed in 245us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185713.504072:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789185713.504164:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58cff117-25e2-45dd-b12f-8a52f6f341b2:14412:1876096821844224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185713.504192:0:14412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185713.504201:0:14412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185713.504203:0:14412:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789185713.504210:0:14412:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c793f283000 00000020:00000080:2.0:1789185713.504212:0:14412:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789185713.504221:0:14412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185713.504224:0:14412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185713.504225:0:14412:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789185713.504228:0:14412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185713.504230:0:14412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185713.504231:0:14412:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789185713.504235:0:14412:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c793f283000 00000020:00000080:2.0:1789185713.504237:0:14412:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789185713.504300:0:14412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185713.504304:0:14412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185713.504305:0:14412:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789185713.504308:0:14412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185713.504311:0:14412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185713.504319:0:14412:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789185713.504323:0:14412:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c793f283000 00000020:00000080:2.0:1789185713.504325:0:14412:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789185713.504365:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58cff117-25e2-45dd-b12f-8a52f6f341b2:14412:1876096821844352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185713.504423:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185713.512591:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821844352 00000100:00100000:3.0:1789185713.512605:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821844352 00000100:00100000:3.0:1789185713.512656:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789185713.512667:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f65a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+11:14412:x1876096821844352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185713.512944:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f65a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+11:14412:x1876096821844352:12345-0@lo:502:llog_process_th.0 Request processed in 279us (8540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185713.512954:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789185713.518012:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7940bdba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185713.518067:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58cff117-25e2-45dd-b12f-8a52f6f341b2:14412:1876096821844352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789185713.518112:0:14412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185713.518122:0:14412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185713.518125:0:14412:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789185713.518132:0:14412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789185713.518682:0:14368:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789185713.518714:0:14368:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789185713.518739:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272ca37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ca3e expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185713.518751:0:14368:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272ca37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ca3e expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185713.518800:0:14368:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789185713.518803:0:14368:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c793f283000 10000000:01000000:0.0:1789185713.518806:0:14368:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c793f283000 10000000:01000000:0.0:1789185713.518810:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789185713.518815:0:14368:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c793f283000 from 1 10000000:01000000:0.0:1789185713.518818:0:14368:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789185713.518852:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7907355e00/0x532743011272ca45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185713.518861:0:14368:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7907355e00/0x532743011272ca45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185713.518869:0:14368:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7907355e00/0x532743011272ca45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185713.518889:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821844480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789185713.518963:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185713.519074:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79011ca540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185713.520673:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821844480 00000100:00100000:2.0:1789185713.520687:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821844480 00000100:00100000:3.0:1789185713.521175:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789185713.521190:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+11:14368:x1876096821844480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185713.521208:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185713.521229:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe04800/0x532743011272ca4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272ca45 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.521258:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe04800/0x532743011272ca4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272ca45 expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.521269:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe04800/0x532743011272ca4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ca45 expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.521290:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04800, rc 0) 00000100:00100000:3.0:1789185713.521371:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14368:x1876096821844480:12345-0@lo:101:mount.lustre.0 Request processed in 185us (2407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185713.521378:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789185713.523108:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821844480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185713.523137:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7907355e00/0x532743011272ca45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ca4c expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185713.523149:0:14368:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7907355e00/0x532743011272ca45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272ca4c expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185713.523229:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821844608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185713.523286:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185713.523326:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79011ca540 going to sleep for 11 seconds 00000100:00100000:1.0:1789185713.523426:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821844608 00000100:00100000:1.0:1789185713.523495:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821844608 00000100:00100000:1.0:1789185713.523538:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789185713.523548:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f659050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14368:x1876096821844608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789185713.523833:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f659050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14368:x1876096821844608:12345-0@lo:501:mount.lustre.0 Request processed in 287us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185713.523848:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789185713.523998:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821844608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185713.524030:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821844736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789185713.524067:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185713.524098:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79011ca540 going to sleep for 11 seconds 00000100:00100000:3.0:1789185713.524148:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821844736 00000100:00100000:3.0:1789185713.524153:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821844736 00000100:00100000:3.0:1789185713.524184:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789185713.524192:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f65a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14368:x1876096821844736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789185713.524345:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f65a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14368:x1876096821844736:12345-0@lo:503:mount.lustre.0 Request processed in 153us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185713.524353:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789185713.525703:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821844736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789185713.530764:0:14417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58cff117-25e2-45dd-b12f-8a52f6f341b2:14417:1876096821844864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185713.530839:0:14417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185713.530882:0:14417:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79073c3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185713.530926:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821844864 00000100:00100000:3.0:1789185713.530934:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821844864 00000100:00100000:3.0:1789185713.530978:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789185713.530987:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14417:x1876096821844864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185713.531219:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14417:x1876096821844864:12345-0@lo:502:llog_process_th.0 Request processed in 230us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185713.531227:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789185713.531284:0:14417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58cff117-25e2-45dd-b12f-8a52f6f341b2:14417:1876096821844864:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789185713.531344:0:14417:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789185713.531362:0:14417:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c793abd4d40) 00000020:00000080:3.0:1789185713.531381:0:14417:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1789185713.531749:0:14417:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c793f283000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789185713.531755:0:14417:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c793f283000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789185713.531758:0:14417:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c793f283000 4 00010000:00080000:3.0:1789185713.531801:0:14417:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c793f1ce000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1789185713.533397:0:14417:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1789185713.533632:0:14417:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789185713.533673:0:14417:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789185713.533690:0:14417:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x532743011272ca5a 00000100:00080000:3.0:1789185713.533700:0:14417:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789185713.533727:0:14417:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c793f1ce000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789185713.533770:0:14417:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c793fc87100 x1876096821844992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789185713.533807:0:14417:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789185713.534057:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876096821844992:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789185713.534139:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185713.534203:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821844992 00000100:00100000:0.0:1789185713.534211:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821844992 00000100:00100000:0.0:1789185713.534242:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185713.534249:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1876096821844992:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789185713.534295:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1876096821844992:12345-0@lo:38:llog_process_th.0 Request processed in 46us (156us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789185713.534313:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185713.534352:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789185713.534359:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c793f1ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185713.534364:0:3277:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789185713.534367:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876096821844992:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789185713.543939:0:14417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58cff117-25e2-45dd-b12f-8a52f6f341b2:14417:1876096821845120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185713.544012:0:14417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185713.544046:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821845120 00000100:00100000:3.0:1789185713.544053:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821845120 00000100:00100000:3.0:1789185713.544084:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789185713.544090:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14417:x1876096821845120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185713.544270:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14417:x1876096821845120:12345-0@lo:502:llog_process_th.0 Request processed in 179us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185713.544276:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789185713.544318:0:14417:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7903d31900 going to sleep for 11 seconds 00000100:00100000:3.0:1789185713.544339:0:14417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58cff117-25e2-45dd-b12f-8a52f6f341b2:14417:1876096821845120:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789185713.544365:0:14417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789185713.544801:0:14368:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789185713.544823:0:14368:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789185713.544879:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7907355e00/0x532743011272ca45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ca4c expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.544904:0:14368:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7907355e00/0x532743011272ca45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ca4c expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789185713.544948:0:14368:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789185713.544950:0:14368:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789185713.544951:0:14368:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185713.544953:0:14368:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185713.544954:0:14368:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185713.544955:0:14368:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185713.544956:0:14368:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789185713.544957:0:14368:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789185713.544960:0:14368:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185713.544961:0:14368:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789185713.544964:0:14368:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789185713.544967:0:14368:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789185713.544968:0:14368:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789185713.544969:0:14368:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185713.544970:0:14368:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185713.544971:0:14368:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185713.544972:0:14368:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185713.544973:0:14368:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789185713.544974:0:14368:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789185713.544975:0:14368:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185713.544976:0:14368:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789185713.544992:0:14368:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789185713.545004:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821845248:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789185713.545052:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185713.545087:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7903d31780 going to sleep for 11 seconds 00000100:00100000:2.0:1789185713.545455:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821845248 00000100:00100000:2.0:1789185713.545464:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821845248 00000100:00100000:3.0:1789185713.545560:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789185713.545570:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14368:x1876096821845248:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789185713.545595:0:14380:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789185713.545610:0:14380:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789185713.570745:0:14380:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789185713.570765:0:14380:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789185713.570824:0:14402:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789185713.570829:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789185713.570853:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7936b4dc00/0x532743011272ca61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185713.570871:0:14402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c793fe05000/0x532743011272ca30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ca29 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185713.570880:0:14402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7936b4dc00/0x532743011272ca61 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185713.570920:0:14402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c793fe05000/0x532743011272ca30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272ca29 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185713.570938:0:14402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c793fe05000/0x532743011272ca30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272ca29 expref: 12 pid: 14380 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185713.570951:0:14402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14402:1876096821845376:0@lo:104: 00000100:00100000:1.0:1789185713.571018:0:14402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185713.571068:0:14402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79073c3840 going to sleep for 11 seconds 00000100:00100000:2.0:1789185713.571141:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821845376 00000100:00100000:2.0:1789185713.571150:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821845376 00000100:00100000:2.0:1789185713.571202:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185713.571212:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58cff117-25e2-45dd-b12f-8a52f6f341b2+3:14402:x1876096821845376:12345-0@lo:104: 00010000:00010000:2.0:1789185713.571227:0:14369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7907354600/0x532743011272ca29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ca30 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185713.571283:0:14369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789185713.571289:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58cff117-25e2-45dd-b12f-8a52f6f341b2+3:14402:x1876096821845376:12345-0@lo:104: Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185713.571295:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185713.571335:0:14402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14402:1876096821845376:0@lo:104: 00010000:00010000:2.0:1789185713.571369:0:14402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7936b4dc00/0x532743011272ca61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.571742:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185713.571761:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7907354600/0x532743011272ca29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ca30 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.571769:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354600 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185713.571773:0:14375:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7907354600/0x532743011272ca29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272ca30 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.571781:0:14375:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7907354600/0x532743011272ca29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272ca30 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185713.571788:0:14375:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7907354600/0x532743011272ca29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272ca30 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185713.571794:0:14375:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185713.571833:0:14375:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7907354600/0x532743011272ca29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ca30 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.571840:0:14375:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185713.571862:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7907354600/0x532743011272ca29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ca30 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.571868:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7907354600/0x532743011272ca29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ca30 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.571885:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185713.571887:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185713.571888:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185713.571915:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58cff117-25e2-45dd-b12f-8a52f6f341b2:3280:1876096821845504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185713.571952:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185713.572016:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821845504 00000100:00100000:3.0:1789185713.572027:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821845504 00010000:00010000:3.0:1789185713.572048:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c793fe05000/0x532743011272ca30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ca29 expref: 13 pid: 14380 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185713.572070:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789185713.572079:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58cff117-25e2-45dd-b12f-8a52f6f341b2+13:3280:x1876096821845504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185713.572091:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185713.572097:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c793fe05000/0x532743011272ca30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ca29 expref: 13 pid: 14380 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.572110:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c793fe05000/0x532743011272ca30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272ca29 expref: 13 pid: 14380 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.572123:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c793fe05000/0x532743011272ca30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272ca29 expref: 13 pid: 14380 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.572137:0:14371:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7936b4dc00/0x532743011272ca61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.572146:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7936b4dc00/0x532743011272ca61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789185713.572160:0:14371:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001330882s 00010000:00010000:3.0:1789185713.572164:0:14371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7936b4dc00/0x532743011272ca61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.572171:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7936b4dc00/0x532743011272ca61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.572178:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7936b4dc00/0x532743011272ca61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.572194:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7936b4dc00/0x532743011272ca61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.572200:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4dc00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185713.572204:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7936b4dc00/0x532743011272ca61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.572211:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7936b4dc00/0x532743011272ca61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.572226:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7936b4dc00/0x532743011272ca61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.572237:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185713.572269:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:3280:x1876096821845504:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185713.572276:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789185713.572311:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58cff117-25e2-45dd-b12f-8a52f6f341b2:3280:1876096821845504:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185713.573863:0:14402:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7936b4dc00/0x532743011272ca61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.573880:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7936b4dc00/0x532743011272ca61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185713.573886:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7936b4dc00/0x532743011272ca61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185713.578301:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+11:14368:x1876096821845248:12345-0@lo:253:mount.lustre.0 Request processed in 32722us (33238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185713.578317:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789185713.578484:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:14368:1876096821845248:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789185713.578500:0:14368:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789185713.578503:0:14368:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789185713.578517:0:14368:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789185713.578519:0:14368:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185713.578520:0:14368:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185713.578521:0:14368:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185713.578523:0:14368:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185713.578524:0:14368:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789185713.578525:0:14368:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789185713.578527:0:14368:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185713.578528:0:14368:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789185713.578544:0:14368:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789185713.583873:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789185713.584031:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789185713.584289:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789185713.584761:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789185713.585029:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789185713.585182:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789185713.586189:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789185713.586651:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789185713.586954:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789185713.587207:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789185713.587748:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789185713.587907:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1789185713.612089:0:14368:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789185713.618872:0:14368:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789185713.619279:0:14424:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789185713.619285:0:14424:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1789185713.621200:0:14425:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1789185713.621561:0:14425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789185713.622601:0:14368:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789185713.622737:0:14368:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789185713.623575:0:14368:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789185713.623588:0:14368:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789185713.623740:0:14368:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789185713.626953:0:14425:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789185713.627053:0:14425:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789185713.627057:0:14425:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1789185713.629160:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789185713.629666:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789185713.629694:0:14368:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1789185713.633666:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1789185713.638815:0:14368:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789185713.671233:0:14368:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789185713.671279:0:14368:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadbe417ab988 00100000:10000000:1.0:1789185713.671288:0:14368:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789185713.672156:0:14368:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789185713.672168:0:14368:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789185713.672180:0:14368:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1789185713.672196:0:14368:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789185714.063758:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789185714.578712:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789185715.025801:0:14383:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789185715.025811:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c793f283000 from 6 10000000:01000000:1.0:1789185715.025817:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789185715.025871:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c200/0x532743011272ca68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185715.025884:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c200/0x532743011272ca68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185715.025897:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c200/0x532743011272ca68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185715.025923:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821845632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789185715.026323:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185715.027086:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7904dad900 going to sleep for 11 seconds 00000100:00100000:3.0:1789185715.031681:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821845632 00000100:00100000:3.0:1789185715.031771:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821845632 00000100:00100000:3.0:1789185715.031884:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789185715.031895:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+11:14383:x1876096821845632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185715.031912:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185715.031932:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe05000/0x532743011272ca6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272ca68 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185715.031960:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe05000/0x532743011272ca6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272ca68 expref: 12 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185715.031974:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe05000/0x532743011272ca6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ca68 expref: 12 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185715.031983:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05000, rc 0) 00000100:00100000:3.0:1789185715.032070:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14383:x1876096821845632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (5747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185715.032076:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789185715.032157:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821845632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185715.032175:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c200/0x532743011272ca68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ca6f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185715.032185:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c200/0x532743011272ca68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272ca6f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185715.032266:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821845760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789185715.032316:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185715.039987:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7904dad900 going to sleep for 11 seconds 00000100:00100000:2.0:1789185715.050994:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821845760 00000100:00100000:2.0:1789185715.051012:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821845760 00000100:00100000:2.0:1789185715.051070:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789185715.051079:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14383:x1876096821845760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789185715.051105:0:14379:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789185715.051131:0:14379:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789185715.051135:0:14379:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789185715.051303:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14383:x1876096821845760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 224us (18985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185715.051310:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789185715.052015:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821845760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789185715.052079:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789185715.052089:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c200/0x532743011272ca68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ca6f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185715.052100:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c200/0x532743011272ca68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ca6f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185715.089016:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789185715.600819:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789185716.112606:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185717.135546:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789185717.893735:0:14668:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789185718.175753:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185718.681923:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58cff117-25e2-45dd-b12f-8a52f6f341b2:3281:1876096821845888:0@lo:400:kworker.0 00000100:00100000:3.0:1789185718.682052:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789185718.682128:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789185718.682133:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789185718.682136:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789185718.682139:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789185718.682141:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789185718.682145:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789185718.682149:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c793f1ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789185718.682163:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c793f1ce000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:1.0:1789185718.682189:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7904d5c000 x1876096821846016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789185718.682234:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876096821846016:0@lo:38:kworker.0 00000100:00100000:1.0:1789185718.682269:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185718.682333:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821846016 00000100:00100000:1.0:1789185718.682341:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821846016 00000100:00100000:1.0:1789185718.682373:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789185718.682381:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1876096821846016:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789185718.682436:0:14388:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 415 last 0 00000100:00100000:2.0:1789185718.682669:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821845888 00000100:00100000:2.0:1789185718.682674:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821845888 00000100:00100000:2.0:1789185718.682706:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789185718.682712:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:3281:x1876096821845888:12345-0@lo:400:kworker.0 00000020:00000080:1.0:1789185718.682771:0:14388:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x532743011272ca76 00000004:00100000:1.0:1789185718.682785:0:14388:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789185718.682920:0:14388:0:(import.c:65:import_set_state_nolock()) ffff9c7936d84000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185718.682961:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876096821846016:12345-0@lo:38:kworker.0 Request processed in 579us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185718.682969:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789185718.683022:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7904d5c000 x1876096821846016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789185718.683037:0:3277:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789185718.683044:0:3277:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789185718.683048:0:3277:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789185718.683050:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c793f1ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789185718.683056:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876096821846016:0@lo:38:kworker.0 00000100:00100000:2.0:1789185718.691300:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:3281:x1876096821845888:12345-0@lo:400:kworker.0 Request processed in 8579us (9240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185718.691316:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789185718.692318:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58cff117-25e2-45dd-b12f-8a52f6f341b2:3281:1876096821845888:0@lo:400:kworker.0 00010000:00010000:0.0:1789185719.184830:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185720.207881:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789185720.878996:0:14818:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff72d56ba0 20000000:00000080:0.0:1789185720.879015:0:14818:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c793c325c00 uarg=0000000000000000 20000000:01000000:0.0:1789185720.879060:0:14818:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789185720.879067:0:14818:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789185720.879073:0:14818:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789185720.881918:0:14819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1789185720.882068:0:14818:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789185720.889913:0:14818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789185720.889943:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7936b4da00/0x532743011272ca7d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185720.889961:0:14818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7936b4ca00/0x532743011272ca3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ca37 expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185720.889970:0:14818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7936b4da00/0x532743011272ca7d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185720.890025:0:14818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7936b4ca00/0x532743011272ca3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272ca37 expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185720.890043:0:14818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7936b4ca00/0x532743011272ca3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272ca37 expref: 11 pid: 14380 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185720.890058:0:14818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14818:1876096821846144:0@lo:104: 00000100:00100000:1.0:1789185720.890120:0:14818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185720.890178:0:14818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b51b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185720.890250:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821846144 00000100:00100000:3.0:1789185720.890257:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821846144 00000100:00100000:3.0:1789185720.890317:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185720.890325:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58cff117-25e2-45dd-b12f-8a52f6f341b2+3:14818:x1876096821846144:12345-0@lo:104: 00010000:00010000:3.0:1789185720.890337:0:14370:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272ca37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ca3e expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890396:0:14370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789185720.890401:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58cff117-25e2-45dd-b12f-8a52f6f341b2+3:14818:x1876096821846144:12345-0@lo:104: Request processed in 78us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185720.890427:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789185720.890449:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185720.890454:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272ca37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ca3e expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890462:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354e00 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185720.890465:0:14375:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272ca37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272ca3e expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890474:0:14375:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272ca37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272ca3e expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185720.890480:0:14375:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272ca37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272ca3e expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185720.890486:0:14375:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789185720.890519:0:14375:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272ca37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ca3e expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890525:0:14375:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185720.890548:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272ca37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ca3e expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890554:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272ca37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ca3e expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890569:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185720.890572:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185720.890574:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185720.890632:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58cff117-25e2-45dd-b12f-8a52f6f341b2:3278:1876096821846272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185720.890673:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185720.890724:0:14818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14818:1876096821846144:0@lo:104: 00010000:00010000:1.0:1789185720.890742:0:14818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7936b4da00/0x532743011272ca7d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185720.890796:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821846272 00000100:00100000:3.0:1789185720.890800:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821846272 00010000:00010000:3.0:1789185720.890819:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7936b4ca00/0x532743011272ca3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ca37 expref: 12 pid: 14380 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185720.890847:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185720.890854:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:3278:x1876096821846272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185720.890865:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185720.890869:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7936b4ca00/0x532743011272ca3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ca37 expref: 12 pid: 14380 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890879:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7936b4ca00/0x532743011272ca3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272ca37 expref: 12 pid: 14380 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890892:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7936b4ca00/0x532743011272ca3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272ca37 expref: 12 pid: 14380 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890905:0:14371:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7936b4da00/0x532743011272ca7d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890913:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7936b4da00/0x532743011272ca7d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890937:0:14371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7936b4da00/0x532743011272ca7d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890945:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7936b4da00/0x532743011272ca7d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890951:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7936b4da00/0x532743011272ca7d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890958:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7936b4da00/0x532743011272ca7d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890962:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4da00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185720.890966:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7936b4da00/0x532743011272ca7d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890974:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7936b4da00/0x532743011272ca7d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.890996:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7936b4da00/0x532743011272ca7d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185720.891005:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185720.891034:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58cff117-25e2-45dd-b12f-8a52f6f341b2+11:3278:x1876096821846272:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185720.891041:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789185720.892851:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58cff117-25e2-45dd-b12f-8a52f6f341b2:3278:1876096821846272:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789185720.892891:0:14818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7936b4da00/0x532743011272ca7d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185720.892901:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7936b4da00/0x532743011272ca7d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185720.892908:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7936b4da00/0x532743011272ca7d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185721.231679:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185722.255554:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789185722.447811:0:14383:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789185722.447827:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c793f283000 from 10 10000000:01000000:2.0:1789185722.447832:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789185722.447878:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79073fe400/0x532743011272ca84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185722.447906:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79073fe400/0x532743011272ca84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185722.447918:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79073fe400/0x532743011272ca84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185722.447944:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821846400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789185722.448014:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185722.448088:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c792f6a1840 going to sleep for 11 seconds 00000100:00100000:0.0:1789185722.448234:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821846400 00000100:00100000:0.0:1789185722.448242:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821846400 00000100:00100000:0.0:1789185722.448303:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789185722.448312:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+11:14383:x1876096821846400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185722.448325:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185722.448342:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7907355000/0x532743011272ca8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272ca84 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185722.448374:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7907355000/0x532743011272ca8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272ca84 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185722.448385:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7907355000/0x532743011272ca8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ca84 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185722.448394:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355000, rc 0) 00000100:00100000:0.0:1789185722.448465:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14383:x1876096821846400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185722.448472:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789185722.448570:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821846400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185722.448585:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79073fe400/0x532743011272ca84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ca8b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185722.448595:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79073fe400/0x532743011272ca84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272ca8b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185722.448652:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821846528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185722.448677:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185722.448710:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185722.448826:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821846528 00000100:00100000:3.0:1789185722.448831:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821846528 00000100:00100000:3.0:1789185722.448861:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185722.448873:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14383:x1876096821846528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185722.449093:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14383:x1876096821846528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185722.449100:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789185722.449172:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821846528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185722.449201:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821846656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185722.449242:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185722.449260:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185722.449431:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821846656 00000100:00100000:3.0:1789185722.449436:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821846656 00000100:00100000:3.0:1789185722.449455:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789185722.449461:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14383:x1876096821846656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185722.449608:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:14383:x1876096821846656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185722.449615:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789185722.449696:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821846656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789185722.450594:0:14879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789185722.452806:0:14383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789185722.452839:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789185722.452850:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79073fe400/0x532743011272ca84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ca8b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185722.452863:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79073fe400/0x532743011272ca84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272ca8b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185723.286674:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789185723.794148:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789185723.794156:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789185723.794159:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789185723.794163:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789185723.794204:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821846912:0@lo:400:kworker.0 00000100:00100000:1.0:1789185723.794286:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185723.794378:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821846912 00000100:00100000:1.0:1789185723.794387:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821846912 00000100:00100000:1.0:1789185723.794469:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185723.794479:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821846912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185723.794533:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821846912:12345-0@lo:400:kworker.0 Request processed in 56us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185723.794540:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789185723.794608:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7904d5e300 x1876096821846912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185723.794637:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821846912:0@lo:400:kworker.0 00000100:00100000:1.0:1789185723.795335:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185713/real 1789185713] req@ffff9c793fc86300 x1876096821843328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185723 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185723.795361:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c793fc86300 x1876096821843328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185723 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185723.795373:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185713/real 1789185713] req@ffff9c793fc87b80 x1876096821843200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185723 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185723.795385:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c793fc87b80 x1876096821843200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185723 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789185723.795401:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c7905456800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789185723.795689:0:3277:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789185723.795693:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821843328:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789185723.795699:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c79405c4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1789185723.795871:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58cff117-25e2-45dd-b12f-8a52f6f341b2:3279:1876096821846784:0@lo:400:kworker.0 00000100:00100000:2.0:1789185723.795935:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185723.796902:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821846784 00000100:00100000:3.0:1789185723.796916:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821846784 00000100:00100000:3.0:1789185723.796971:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789185723.796982:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:3279:x1876096821846784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185723.797065:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:3279:x1876096821846784:12345-0@lo:400:kworker.0 Request processed in 85us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185723.797073:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789185723.797424:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58cff117-25e2-45dd-b12f-8a52f6f341b2:3279:1876096821846784:0@lo:400:kworker.0 00000100:00080000:0.0:1789185723.799242:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185723.799255:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789185723.799260:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c79405c4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185723.799268:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 410 00000100:00080000:0.0:1789185723.799275:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789185723.799289:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c79405c4000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:0.0:1789185723.799337:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7936b5e300 x1876096821847040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185723.799357:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185723.799361:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789185723.799363:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7905456800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185723.799366:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 410 00000100:00080000:0.0:1789185723.799370:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789185723.799375:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7905456800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:0.0:1789185723.799685:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7936b5ca80 x1876096821847168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789185723.801871:0:3277:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789185723.801885:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821843200:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789185723.801946:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821847040:0@lo:8:kworker.0 00000400:00000100:1.0:1789185723.802024:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876096821847040 offset 0 length 520: 4 00000100:00100000:1.0:1789185723.802075:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821847168:0@lo:8:kworker.0 00000400:00000100:1.0:1789185723.802100:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876096821847168 offset 0 length 520: 4 00010000:00010000:3.0:1789185724.304642:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185725.330809:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789185725.843452:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1789185726.076550:0:15067:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789185726.076554:0:15067:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789185726.076677:0:15067:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c79101b0000 00000020:01000004:3.0:1789185726.076693:0:15067:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789185726.076705:0:15067:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789185726.076720:0:15067:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c793abd3380) 00000020:00000080:3.0:1789185726.076735:0:15067:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789185726.098735:0:15067:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789185726.099112:0:15067:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789185726.100023:0:15067:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789185726.100236:0:15067:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789185726.100585:0:15067:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789185726.101003:0:15067:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 691: rc = 0 00100000:10000000:2.0:1789185726.101105:0:15067:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 691: rc = 0 00100000:10000000:2.0:1789185726.101190:0:15067:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 691: rc = 0 00100000:10000000:2.0:1789185726.101891:0:15067:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 391: rc = 0 00100000:10000000:2.0:1789185726.102141:0:15067:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 391: rc = 0 00100000:10000000:2.0:1789185726.102382:0:15067:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 391: rc = 0 00100000:10000000:2.0:1789185726.102747:0:15067:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 391: rc = 0 00100000:10000000:2.0:1789185726.103066:0:15067:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 391: rc = 0 00100000:10000000:2.0:1789185726.103310:0:15067:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 391: rc = 0 00000020:00000080:2.0:1789185726.104154:0:15067:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789185726.104166:0:15067:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789185726.104177:0:15067:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x532743011272ca99 00000020:01000004:2.0:1789185726.104185:0:15067:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789185726.104208:0:15067:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789185726.104212:0:15067:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789185726.104218:0:15067:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789185726.104223:0:15067:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789185726.104235:0:15067:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c7907233380) 00000020:00000080:2.0:1789185726.104245:0:15067:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789185726.105436:0:15067:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789185726.105558:0:15067:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789185726.105561:0:15067:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789185726.106487:0:15067:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789185726.106496:0:15067:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789185726.106914:0:15067:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789185726.106921:0:15067:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789185726.108280:0:15067:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789185726.108485:0:15067:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789185726.108491:0:15067:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789185726.115054:0:15067:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789185726.115067:0:15067:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789185726.128314:0:15067:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789185726.128775:0:15067:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789185726.128783:0:15067:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789185726.130247:0:15067:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789185726.130261:0:15067:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789185726.131255:0:15067:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789185726.131265:0:15067:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789185726.133911:0:15067:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789185726.134184:0:15067:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789185726.134191:0:15067:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789185726.135065:0:15067:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789185726.135150:0:15067:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789185726.168169:0:15067:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185726.168366:0:15067:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789185726.168372:0:15067:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789185726.169517:0:15067:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789185726.169526:0:15067:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789185726.169841:0:15067:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789185726.169866:0:15067:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789185726.169872:0:15067:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789185726.187578:0:15067:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789185726.187628:0:15067:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.154@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789185726.187633:0:15067:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789185726.187635:0:15067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789185726.187637:0:15067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185726.187638:0:15067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185726.187640:0:15067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185726.187641:0:15067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185726.187643:0:15067:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789185726.187645:0:15067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185726.187646:0:15067:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789185726.187650:0:15067:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789185726.187653:0:15067:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789185726.187654:0:15067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789185726.187655:0:15067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185726.187657:0:15067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185726.187658:0:15067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185726.187659:0:15067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185726.187660:0:15067:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789185726.187661:0:15067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185726.187663:0:15067:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789185726.187689:0:15067:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789185726.187709:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821847296:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789185726.187797:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185726.187915:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7910fcb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185726.188030:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821847296 00000100:00100000:2.0:1789185726.188039:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821847296 00000100:00100000:2.0:1789185726.188194:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789185726.188211:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:15067:x1876096821847296:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789185726.188242:0:14379:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789185726.188245:0:14379:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789185726.188249:0:14379:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789185726.193433:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:15067:x1876096821847296:12345-0@lo:253:mount.lustre.0 Request processed in 5192us (5604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185726.193446:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185726.194065:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821847296:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789185726.194094:0:15067:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789185726.194098:0:15067:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789185726.194099:0:15067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789185726.194101:0:15067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185726.194103:0:15067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185726.194104:0:15067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185726.194106:0:15067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185726.194107:0:15067:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789185726.194109:0:15067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185726.194111:0:15067:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789185726.194131:0:15067:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c79101b0000 from lustre-OST0000 10000000:01000000:3.0:1789185726.194158:0:15067:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789185726.194162:0:15067:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789185726.194168:0:15067:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c792f804d40 local copy 00010000:00010000:3.0:1789185726.194179:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272c98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272c996 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185726.194554:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821847424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185726.194611:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185726.194651:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c30e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185726.194720:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821847424 00000100:00100000:0.0:1789185726.194727:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821847424 00000100:00100000:0.0:1789185726.194769:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789185726.194779:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:15067:x1876096821847424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185726.194936:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:15067:x1876096821847424:12345-0@lo:501:mount.lustre.0 Request processed in 159us (324us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789185726.194944:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789185726.195046:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821847424:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789185726.195078:0:15067:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789185726.195222:0:15067:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789185726.195241:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272c98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272c996 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185726.195252:0:15067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272c98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272c996 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185726.195279:0:15067:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c79101b0000 10000000:01000000:1.0:1789185726.195285:0:15067:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789185726.195291:0:15067:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c792f804d40 10000000:01000000:1.0:1789185726.195294:0:15067:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789185726.195298:0:15067:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c792f804d40 from 1 10000000:01000000:1.0:1789185726.195301:0:15067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789185726.195334:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c000/0x532743011272caa7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185726.195344:0:15067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c000/0x532743011272caa7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185726.195355:0:15067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c000/0x532743011272caa7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185726.195368:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821847552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789185726.195398:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185726.195454:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b51b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185726.195980:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821847552 00000100:00100000:0.0:1789185726.195987:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821847552 00000100:00100000:0.0:1789185726.196015:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789185726.196022:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+12:15067:x1876096821847552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185726.196034:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185726.196047:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7907354400/0x532743011272caae lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272caa7 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.196081:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7907354400/0x532743011272caae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272caa7 expref: 13 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.196092:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7907354400/0x532743011272caae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272caa7 expref: 13 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.196100:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354400, rc 0) 00000100:00100000:0.0:1789185726.196148:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+13:15067:x1876096821847552:12345-0@lo:101:mount.lustre.0 Request processed in 126us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185726.196154:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789185726.196345:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821847552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185726.196361:0:15067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c000/0x532743011272caa7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272caae expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185726.196380:0:15067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c000/0x532743011272caa7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272caae expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185726.196398:0:15067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789185726.196433:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c000/0x532743011272caa7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272caae expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185726.196441:0:15067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c000/0x532743011272caa7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272caae expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185726.196447:0:15067:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789185726.196452:0:15067:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789185726.196456:0:15067:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789185726.196458:0:15067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789185726.196476:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4de00/0x532743011272cab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185726.196483:0:15067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7936b4de00/0x532743011272cab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185726.196490:0:15067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7936b4de00/0x532743011272cab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185726.196503:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821847680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789185726.196532:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185726.196551:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b51b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185726.196619:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821847680 00000100:00100000:0.0:1789185726.196629:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821847680 00000100:00100000:0.0:1789185726.196648:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789185726.196655:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+13:15067:x1876096821847680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185726.196662:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185726.196670:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7907355400/0x532743011272cabc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272cab5 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.196686:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7907355400/0x532743011272cabc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272cab5 expref: 14 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.196694:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7907355400/0x532743011272cabc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272cab5 expref: 14 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.196700:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355400, rc 0) 00000100:00100000:0.0:1789185726.196737:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+14:15067:x1876096821847680:12345-0@lo:101:mount.lustre.0 Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185726.196744:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789185726.196993:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821847680:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185726.197004:0:15067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7936b4de00/0x532743011272cab5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cabc expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185726.197018:0:15067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7936b4de00/0x532743011272cab5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272cabc expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789185726.197829:0:15067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789185726.200492:0:15067:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789185726.200767:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789185726.200815:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789185726.200852:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789185726.200905:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789185726.200945:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789185726.200997:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789185726.201164:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789185726.201173:0:15067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789185726.201331:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821847808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789185726.201397:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185726.201640:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b51e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185726.201675:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821847808 00000100:00100000:0.0:1789185726.201684:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821847808 00000100:00100000:0.0:1789185726.201763:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789185726.201773:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+14:15067:x1876096821847808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185726.202111:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+14:15067:x1876096821847808:12345-0@lo:501:mount.lustre.0 Request processed in 339us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185726.202119:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789185726.202186:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821847808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789185726.202220:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821847936:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789185726.202270:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185726.202624:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b51e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185726.202696:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821847936 00000100:00100000:3.0:1789185726.202701:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821847936 00000100:00100000:3.0:1789185726.202727:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789185726.202734:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+14:15067:x1876096821847936:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789185726.203052:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+14:15067:x1876096821847936:12345-0@lo:503:mount.lustre.0 Request processed in 317us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185726.203060:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789185726.203214:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821847936:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789185726.203976:0:15067:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789185726.204044:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185726.204109:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185726.204136:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b51e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185726.204394:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821848064 00000100:00100000:3.0:1789185726.204398:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821848064 00000100:00100000:3.0:1789185726.204449:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789185726.204457:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+14:15067:x1876096821848064:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185726.204665:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+14:15067:x1876096821848064:12345-0@lo:502:mount.lustre.0 Request processed in 208us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185726.204673:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789185726.204848:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848064:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789185726.205625:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789185726.205692:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789185726.205729:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789185726.205779:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789185726.205828:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789185726.205865:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789185726.205911:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789185726.205947:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789185726.205980:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789185726.206031:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789185726.206321:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789185726.206505:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789185726.206558:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848192:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185726.206640:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185726.206730:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b51e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185726.206823:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821848192 00000100:00100000:2.0:1789185726.206831:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821848192 00000100:00100000:3.0:1789185726.206933:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789185726.206945:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+14:15067:x1876096821848192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185726.207360:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+14:15067:x1876096821848192:12345-0@lo:502:mount.lustre.0 Request processed in 417us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185726.207368:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789185726.207693:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789185726.207792:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789185726.207808:0:15067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1789185726.208824:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789185726.208835:0:15081:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789185726.208841:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185726.208844:0:15081:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789185726.208850:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789185726.208866:0:15081:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c792fab99c0) 00000020:00000080:1.0:1789185726.208892:0:15081:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789185726.208899:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789185726.208962:0:15081:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c79101b0000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789185726.208969:0:15081:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789185726.208976:0:15081:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x532743011272caca 00010000:00010000:1.0:1789185726.216819:0:15081:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1789185726.217603:0:15081:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1789185726.219705:0:15081:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789185726.221371:0:15081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789185726.221385:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185726.221391:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185726.221393:0:15081:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789185726.221396:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789185726.221399:0:15081:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1789185726.221401:0:15081:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789185726.221402:0:15081:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789185726.221482:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789185726.221487:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185726.221488:0:15081:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789185726.221492:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185726.221495:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185726.221496:0:15081:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789185726.221499:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789185726.221501:0:15081:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789185726.221504:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185726.221506:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185726.221508:0:15081:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789185726.221510:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185726.221512:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185726.221513:0:15081:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789185726.221516:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789185726.221581:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185726.221584:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185726.221586:0:15081:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789185726.221600:0:15081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789185726.223662:0:15067:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789185726.223699:0:15067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789185726.223717:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7936b4de00/0x532743011272cab5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cabc expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185726.223730:0:15067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7936b4de00/0x532743011272cab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cabc expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185726.223738:0:15067:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c79101b0000 from 1 10000000:01000000:3.0:1789185726.223741:0:15067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185726.223779:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04200/0x532743011272cad1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185726.223789:0:15067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c793fe04200/0x532743011272cad1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185726.223800:0:15067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c793fe04200/0x532743011272cad1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185726.223834:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc86d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789185726.223908:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185726.223957:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821848320 00000100:00100000:3.0:1789185726.223964:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821848320 00000100:00100000:3.0:1789185726.224011:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789185726.224019:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+14:15067:x1876096821848320:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185726.224032:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185726.224046:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe04000/0x532743011272cad8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272cad1 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185726.224692:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe04000/0x532743011272cad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272cad1 expref: 15 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185726.224708:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe04000/0x532743011272cad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272cad1 expref: 15 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185726.224718:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04000, rc 0) 00000100:00100000:3.0:1789185726.224767:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+15:15067:x1876096821848320:12345-0@lo:101:mount.lustre.0 Request processed in 747us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185726.224775:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789185726.224827:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7910fcb000 going to sleep for 11 seconds 00000100:00100000:3.0:1789185726.224853:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc86d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185726.224868:0:15067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c793fe04200/0x532743011272cad1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cad8 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185726.224877:0:15067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c793fe04200/0x532743011272cad1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272cad8 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789185726.225655:0:15067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789185726.227428:0:15067:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789185726.227739:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789185726.227785:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789185726.227859:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789185726.227868:0:15067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789185726.227954:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc86d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185726.228021:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185726.228329:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7910fcb000 going to sleep for 11 seconds 00000100:00100000:2.0:1789185726.230975:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821848448 00000100:00100000:2.0:1789185726.230991:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821848448 00000100:00100000:2.0:1789185726.231037:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789185726.231046:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+15:15067:x1876096821848448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185726.231562:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+15:15067:x1876096821848448:12345-0@lo:501:mount.lustre.0 Request processed in 515us (3538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185726.231570:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789185726.231708:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc86d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789185726.231758:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789185726.231803:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185726.231838:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7902ba8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185726.231891:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821848576 00000100:00100000:2.0:1789185726.231895:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821848576 00000100:00100000:2.0:1789185726.231925:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789185726.231932:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+15:15067:x1876096821848576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789185726.232144:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+15:15067:x1876096821848576:12345-0@lo:503:mount.lustre.0 Request processed in 212us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185726.232152:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789185726.232448:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848576:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789185726.232974:0:15067:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789185726.233042:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848704:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185726.235636:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185726.235683:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7902ba8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185726.235832:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821848704 00000100:00100000:2.0:1789185726.235841:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821848704 00000100:00100000:2.0:1789185726.235900:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789185726.235910:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+15:15067:x1876096821848704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789185726.236315:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+15:15067:x1876096821848704:12345-0@lo:502:mount.lustre.0 Request processed in 406us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185726.236323:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789185726.236864:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848704:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789185726.238491:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789185726.238574:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789185726.238660:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789185726.238703:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789185726.238736:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789185726.238786:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789185726.238823:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789185726.238858:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789185726.238908:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848832:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185726.238982:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185726.240371:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7902ba8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185726.246029:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821848832 00000100:00100000:3.0:1789185726.246047:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821848832 00000100:00100000:3.0:1789185726.246149:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789185726.246160:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+15:15067:x1876096821848832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185726.246495:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+15:15067:x1876096821848832:12345-0@lo:502:mount.lustre.0 Request processed in 334us (7510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185726.246502:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789185726.246641:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789185726.246803:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789185726.246821:0:15067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789185726.250203:0:15085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185726.250216:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185726.250219:0:15085:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789185726.250226:0:15085:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c79101b0000 00000020:00000080:1.0:1789185726.250229:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789185726.250237:0:15085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185726.250240:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185726.250251:0:15085:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789185726.250255:0:15085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185726.250258:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185726.250259:0:15085:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789185726.250262:0:15085:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c79101b0000 00000020:00000080:1.0:1789185726.250275:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789185726.250333:0:15085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185726.250336:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185726.250337:0:15085:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789185726.250339:0:15085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185726.250342:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185726.250343:0:15085:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789185726.250346:0:15085:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c79101b0000 00000020:00000080:1.0:1789185726.250348:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789185726.250395:0:15085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185726.250399:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185726.250400:0:15085:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789185726.250422:0:15085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789185726.254251:0:15067:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789185726.254296:0:15067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789185726.254321:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04200/0x532743011272cad1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cad8 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185726.254335:0:15067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c793fe04200/0x532743011272cad1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cad8 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185726.254390:0:15067:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789185726.254393:0:15067:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c79101b0000 10000000:01000000:2.0:1789185726.254396:0:15067:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c79101b0000 10000000:01000000:2.0:1789185726.254401:0:15067:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789185726.254423:0:15067:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c79101b0000 from 1 10000000:01000000:2.0:1789185726.254427:0:15067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789185726.254461:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79073fe800/0x532743011272cadf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185726.254469:0:15067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79073fe800/0x532743011272cadf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185726.254480:0:15067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79073fe800/0x532743011272cadf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185726.254504:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789185726.254567:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185726.254617:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c790685a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789185726.254737:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821848960 00000100:00100000:3.0:1789185726.254744:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821848960 00000100:00100000:3.0:1789185726.254814:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789185726.254824:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+15:15067:x1876096821848960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185726.254838:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185726.254851:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe05e00/0x532743011272cae6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272cadf expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185726.254872:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe05e00/0x532743011272cae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272cadf expref: 16 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185726.254944:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe05e00/0x532743011272cae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272cadf expref: 16 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185726.254954:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05e00, rc 0) 00000100:00100000:3.0:1789185726.254996:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:15067:x1876096821848960:12345-0@lo:101:mount.lustre.0 Request processed in 174us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185726.255003:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789185726.255969:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821848960:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789185726.255992:0:15067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79073fe800/0x532743011272cadf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cae6 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185726.256001:0:15067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79073fe800/0x532743011272cadf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272cae6 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789185726.256811:0:15067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789185726.263380:0:15067:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185726.263820:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789185726.263897:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789185726.263965:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789185726.264050:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789185726.264118:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789185726.264184:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789185726.264240:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789185726.264279:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789185726.264342:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789185726.264398:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789185726.264458:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789185726.264505:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789185726.264540:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789185726.264574:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789185726.269046:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789185726.269109:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789185726.269143:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789185726.269191:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789185726.270716:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789185726.271058:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789185726.271143:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789185726.271184:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789185726.271387:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789185726.271488:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789185726.271528:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789185726.271586:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789185726.271684:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789185726.271724:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789185726.271817:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789185726.271826:0:15067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789185726.274233:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821849088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185726.274316:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185726.274362:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c790685a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789185726.274905:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821849088 00000100:00100000:3.0:1789185726.274914:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821849088 00000100:00100000:3.0:1789185726.274971:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789185726.274980:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:15067:x1876096821849088:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185726.275256:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:15067:x1876096821849088:12345-0@lo:501:mount.lustre.0 Request processed in 277us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185726.275264:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789185726.275645:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821849088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185726.275692:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821849216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789185726.275740:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185726.275768:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c790685a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789185726.275814:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821849216 00000100:00100000:3.0:1789185726.275819:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821849216 00000100:00100000:3.0:1789185726.275853:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789185726.275860:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:15067:x1876096821849216:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789185726.276025:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:15067:x1876096821849216:12345-0@lo:503:mount.lustre.0 Request processed in 164us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185726.276031:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789185726.276142:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821849216:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789185726.276836:0:15067:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789185726.276913:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821849344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789185726.277070:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185726.278433:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c790685a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789185726.288738:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821849344 00000100:00100000:3.0:1789185726.288755:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821849344 00000100:00100000:3.0:1789185726.288821:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789185726.288832:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:15067:x1876096821849344:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185726.289143:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:15067:x1876096821849344:12345-0@lo:502:mount.lustre.0 Request processed in 312us (12071us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185726.289157:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789185726.289315:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821849344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789185726.289655:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789185726.289736:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789185726.289782:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789185726.289847:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789185726.289902:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789185726.289997:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789185726.290069:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789185726.290120:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789185726.290170:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789185726.290207:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789185726.290240:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789185726.290300:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789185726.290340:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789185726.290373:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789185726.290453:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789185726.290498:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789185726.293909:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789185726.293993:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789185726.294029:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789185726.294061:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789185726.294108:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789185726.294144:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789185726.294206:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789185726.294471:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789185726.294514:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789185726.294551:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789185726.294826:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789185726.294869:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789185726.294905:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789185726.294954:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789185726.294993:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789185726.295032:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789185726.295067:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789185726.295132:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789185726.295173:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789185726.295346:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789185726.295388:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789185726.295444:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789185726.295506:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789185726.295538:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789185726.296391:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821849472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789185726.296496:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185726.296552:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821849472 00000100:00100000:2.0:1789185726.296561:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821849472 00000100:00100000:2.0:1789185726.296868:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789185726.296880:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:15067:x1876096821849472:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789185726.297142:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:15067:x1876096821849472:12345-0@lo:502:mount.lustre.0 Request processed in 264us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185726.297150:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789185726.297203:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c790685a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789185726.297242:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821849472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789185726.298530:0:15067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789185726.298547:0:15067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789185726.303584:0:15090:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789185726.303613:0:15090:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c79072319c0) 00000020:00000080:2.0:1789185726.303639:0:15090:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789185726.303721:0:15090:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c79101b0000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789185726.303727:0:15090:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c79101b0000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789185726.303730:0:15090:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c79101b0000 3 00010000:00080000:2.0:1789185726.303761:0:15090:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c791f9a1800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.154@tcp at head 00010000:00010000:2.0:1789185726.308240:0:15090:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1789185726.312963:0:15090:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789185726.313006:0:15090:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789185726.313020:0:15090:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x532743011272caf4 00000100:00080000:2.0:1789185726.313032:0:15090:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789185726.313044:0:15090:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c791f9a1800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:2.0:1789185726.313082:0:15090:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c793f25f800 x1876096821849600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789185726.313169:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1876096821849600:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789185726.313246:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185726.314119:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821849600 00000100:00100000:3.0:1789185726.314129:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821849600 00000100:00100000:3.0:1789185726.314170:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185726.314180:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1876096821849600:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789185726.314209:0:14386:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:3.0:1789185726.314248:0:14386:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x532743011272cafb 00000004:00100000:3.0:1789185726.314279:0:14386:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789185726.314313:0:14386:0:(import.c:65:import_set_state_nolock()) ffff9c7904f07000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789185726.316244:0:15090:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789185726.316342:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185726.316349:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789185726.316351:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185726.316365:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789185726.316781:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821849728:0@lo:400:kworker.0 00000100:00100000:2.0:1789185726.316856:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789185726.317050:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1789185726.322473:0:14387:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789185726.322487:0:14387:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789185726.322616:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821849728 00000100:00100000:0.0:1789185726.322626:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821849728 00000100:00100000:0.0:1789185726.322677:0:14387:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789185726.322690:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789185726.322700:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821849728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185726.322794:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821849728:12345-0@lo:400:kworker.0 Request processed in 96us (5939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185726.322802:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789185726.322845:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7936b5df80 x1876096821849728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185726.322859:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821849728:0@lo:400:kworker.0 00000100:00100000:3.0:1789185726.325025:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876096821849600:12345-0@lo:38:llog_process_th.0 Request processed in 10837us (11769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185726.325042:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1789185726.325462:0:15067:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789185726.325499:0:15067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789185726.325525:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79073fe800/0x532743011272cadf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cae6 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185726.325537:0:15067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79073fe800/0x532743011272cadf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cae6 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789185726.325632:0:15067:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789185726.325635:0:15067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789185726.325636:0:15067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185726.325637:0:15067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185726.325639:0:15067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185726.325641:0:15067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185726.325642:0:15067:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185726.325644:0:15067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185726.325656:0:15067:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789185726.325660:0:15067:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789185726.325663:0:15067:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789185726.325665:0:15067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789185726.325666:0:15067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185726.325667:0:15067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185726.325668:0:15067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185726.325669:0:15067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185726.325670:0:15067:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185726.325672:0:15067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185726.325673:0:15067:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789185726.325702:0:15067:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789185726.325721:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821849856:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789185726.325793:0:15067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185726.325840:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c790685aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185726.325930:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821849856 00000100:00100000:3.0:1789185726.325939:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821849856 00000100:00100000:3.0:1789185726.325994:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789185726.326005:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:15067:x1876096821849856:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789185726.326031:0:14379:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789185726.326044:0:14379:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1789185726.330770:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c793f25f800 x1876096821849600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185726.330788:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789185726.330800:0:3277:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789185726.330810:0:3277:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789185726.330815:0:3277:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789185726.330819:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c791f9a1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789185726.330826:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1876096821849600:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1789185726.351939:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1789185726.401690:0:14379:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789185726.401710:0:14379:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789185726.401777:0:14402:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789185726.401783:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789185726.401806:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c79073fec00/0x532743011272cb02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185726.401824:0:14402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c793fe05000/0x532743011272ca6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ca68 expref: 16 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185726.401833:0:14402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c79073fec00/0x532743011272cb02 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185726.401875:0:14402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c793fe05000/0x532743011272ca6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272ca68 expref: 16 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185726.401893:0:14402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c793fe05000/0x532743011272ca6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272ca68 expref: 16 pid: 14381 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185726.401907:0:14402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14402:1876096821849984:0@lo:104: 00000100:00100000:2.0:1789185726.401973:0:14402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185726.402022:0:14402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c30900 going to sleep for 11 seconds 00000100:00100000:3.0:1789185726.402268:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821849984 00000100:00100000:3.0:1789185726.402276:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821849984 00000100:00100000:3.0:1789185726.402329:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185726.402340:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58cff117-25e2-45dd-b12f-8a52f6f341b2+3:14402:x1876096821849984:12345-0@lo:104: 00010000:00010000:3.0:1789185726.402352:0:14369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c200/0x532743011272ca68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ca6f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185726.402450:0:14369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789185726.402456:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58cff117-25e2-45dd-b12f-8a52f6f341b2+3:14402:x1876096821849984:12345-0@lo:104: Request processed in 118us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185726.402464:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789185726.402978:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185726.402987:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c200/0x532743011272ca68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ca6f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185726.402997:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c200 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:2.0:1789185726.403000:0:14374:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c200/0x532743011272ca68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272ca6f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185726.403009:0:14374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c200/0x532743011272ca68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272ca6f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185726.403022:0:14374:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c200/0x532743011272ca68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272ca6f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185726.403027:0:14374:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789185726.403075:0:14374:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c200/0x532743011272ca68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ca6f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185726.403082:0:14374:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185726.403101:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c200/0x532743011272ca68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ca6f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185726.403108:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7936b4c200/0x532743011272ca68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ca6f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185726.403124:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185726.403125:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185726.403126:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185726.403142:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58cff117-25e2-45dd-b12f-8a52f6f341b2:3278:1876096821850112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185726.403177:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185726.403233:0:14402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14402:1876096821849984:0@lo:104: 00010000:00010000:2.0:1789185726.403250:0:14402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c79073fec00/0x532743011272cb02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185726.403531:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821850112 00000100:00100000:0.0:1789185726.403536:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821850112 00010000:00010000:0.0:1789185726.403560:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c793fe05000/0x532743011272ca6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ca68 expref: 17 pid: 14381 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185726.403585:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789185726.403603:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:3278:x1876096821850112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185726.403615:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185726.403620:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c793fe05000/0x532743011272ca6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ca68 expref: 17 pid: 14381 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.403633:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c793fe05000/0x532743011272ca6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272ca68 expref: 17 pid: 14381 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.403658:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c793fe05000/0x532743011272ca6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272ca68 expref: 17 pid: 14381 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.403670:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c79073fec00/0x532743011272cb02 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.403678:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79073fec00/0x532743011272cb02 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789185726.403691:0:14373:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001909135s 00010000:00010000:0.0:1789185726.403695:0:14373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c79073fec00/0x532743011272cb02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.403701:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c79073fec00/0x532743011272cb02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.403708:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c79073fec00/0x532743011272cb02 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.403715:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c79073fec00/0x532743011272cb02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.403720:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fec00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185726.403724:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c79073fec00/0x532743011272cb02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.403730:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c79073fec00/0x532743011272cb02 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.403744:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c79073fec00/0x532743011272cb02 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.403758:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185726.403799:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:3278:x1876096821850112:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185726.403805:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789185726.403842:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58cff117-25e2-45dd-b12f-8a52f6f341b2:3278:1876096821850112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185726.403860:0:14402:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c79073fec00/0x532743011272cb02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.403867:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c79073fec00/0x532743011272cb02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185726.403873:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79073fec00/0x532743011272cb02 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185726.420188:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+15:15067:x1876096821849856:12345-0@lo:253:mount.lustre.0 Request processed in 94175us (94383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185726.420229:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789185726.420467:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15067:1876096821849856:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789185726.420484:0:15067:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789185726.420487:0:15067:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789185726.420489:0:15067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789185726.420490:0:15067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185726.420498:0:15067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185726.420499:0:15067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185726.420500:0:15067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185726.420502:0:15067:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185726.420503:0:15067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185726.420505:0:15067:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789185726.420524:0:15067:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789185726.430790:0:15067:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789185726.430970:0:15067:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789185726.431130:0:15067:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789185726.431680:0:15067:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789185726.431846:0:15067:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789185726.432068:0:15067:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789185726.433785:0:15067:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789185726.493849:0:15067:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789185726.493860:0:15067:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789185726.493892:0:15067:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789185726.493957:0:15067:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789185726.493972:0:15067:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789185726.494001:0:15067:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789185727.380386:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789185727.696378:0:14383:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789185727.696386:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c793f283000 from 7 10000000:01000000:0.0:1789185727.696391:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789185727.696471:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7907355200/0x532743011272cb09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185727.696484:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7907355200/0x532743011272cb09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185727.696496:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7907355200/0x532743011272cb09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185727.696523:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821850240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185727.696601:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185727.696650:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7902ab83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185727.696763:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821850240 00000100:00100000:2.0:1789185727.696773:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821850240 00000100:00100000:2.0:1789185727.696835:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789185727.696845:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+15:14383:x1876096821850240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185727.696859:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185727.696873:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79073ff800/0x532743011272cb10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272cb09 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185727.696896:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79073ff800/0x532743011272cb10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272cb09 expref: 16 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185727.696906:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79073ff800/0x532743011272cb10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272cb09 expref: 16 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185727.696915:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79073ff800, rc 0) 00000100:00100000:2.0:1789185727.696967:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:14383:x1876096821850240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185727.696974:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789185727.697059:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821850240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185727.697086:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7907355200/0x532743011272cb09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cb10 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185727.697096:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7907355200/0x532743011272cb09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272cb10 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185727.697145:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821850368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789185727.697177:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185727.697208:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906588f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185727.697376:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821850368 00000100:00100000:2.0:1789185727.697381:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821850368 00000100:00100000:2.0:1789185727.697435:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789185727.697443:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:14383:x1876096821850368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789185727.697457:0:14379:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789185727.697474:0:14379:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789185727.697481:0:14379:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789185727.697558:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:14383:x1876096821850368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185727.697565:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789185727.697667:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821850368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789185727.697731:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789185727.697738:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7907355200/0x532743011272cb09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cb10 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185727.697747:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7907355200/0x532743011272cb09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cb10 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185728.403611:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185729.427618:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185730.448180:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185731.471728:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789185731.485350:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789185731.485357:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789185731.485360:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789185731.485364:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789185731.485433:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789185731.485456:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58cff117-25e2-45dd-b12f-8a52f6f341b2:3278:1876096821850496:0@lo:400:kworker.0 00000100:00100000:2.0:1789185731.485536:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185731.485608:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821850624:0@lo:400:kworker.0 00000100:00100000:2.0:1789185731.485636:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185731.485657:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185731.485682:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821850752:0@lo:400:kworker.0 00000100:00100000:2.0:1789185731.485707:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185731.485745:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821850496 00000100:00100000:2.0:1789185731.485752:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821850496 00000100:00100000:2.0:1789185731.485795:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789185731.485804:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:3278:x1876096821850496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185731.485855:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:3278:x1876096821850496:12345-0@lo:400:kworker.0 Request processed in 51us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185731.485862:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789185731.485896:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821850624 00000100:00100000:2.0:1789185731.485900:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821850624 00000100:00100000:2.0:1789185731.485933:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821850752 00000100:00100000:2.0:1789185731.485945:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821850752 00000100:00100000:2.0:1789185731.485979:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185731.485985:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821850624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185731.486020:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821850624:12345-0@lo:400:kworker.0 Request processed in 36us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185731.486026:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185731.486036:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789185731.486041:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821850752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185731.486064:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821850752:12345-0@lo:400:kworker.0 Request processed in 23us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185731.486069:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789185731.486107:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c793f25ca80 x1876096821850752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185731.486121:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821850752:0@lo:400:kworker.0 00010000:00080000:2.0:1789185731.486132:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c793f25ed80 x1876096821850624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185731.486140:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821850624:0@lo:400:kworker.0 00000100:00100000:2.0:1789185731.486168:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58cff117-25e2-45dd-b12f-8a52f6f341b2:3278:1876096821850496:0@lo:400:kworker.0 00000100:00080000:3.0:1789185731.486568:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789185732.495591:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789185732.783818:0:15437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789185733.520386:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185734.544971:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789185735.057066:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789185735.570210:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789185736.591639:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185736.591649:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789185736.591653:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185736.591657:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789185736.591735:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58cff117-25e2-45dd-b12f-8a52f6f341b2:3278:1876096821850880:0@lo:400:kworker.0 00000100:00100000:0.0:1789185736.591835:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185736.591914:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185736.591922:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821851008:0@lo:400:kworker.0 00000100:00100000:0.0:1789185736.591957:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185736.592000:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821851136:0@lo:400:kworker.0 00000100:00100000:0.0:1789185736.592034:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789185736.592037:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185736.592084:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821850880 00000100:00100000:0.0:1789185736.592095:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821850880 00000100:00100000:0.0:1789185736.592210:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789185736.592224:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:3278:x1876096821850880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185736.592300:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:3278:x1876096821850880:12345-0@lo:400:kworker.0 Request processed in 80us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185736.592308:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789185736.592836:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821851008 00000100:00100000:1.0:1789185736.592843:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821851008 00000100:00100000:1.0:1789185736.592880:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821851136 00000100:00100000:1.0:1789185736.592883:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821851136 00000100:00100000:1.0:1789185736.592926:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789185736.592936:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821851008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185736.592987:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821851008:12345-0@lo:400:kworker.0 Request processed in 54us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185736.593012:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789185736.593028:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185736.593035:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821851136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185736.593070:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821851136:12345-0@lo:400:kworker.0 Request processed in 37us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185736.593077:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789185736.593101:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789185736.593139:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7936b5dc00 x1876096821851136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185736.593156:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821851136:0@lo:400:kworker.0 00010000:00080000:1.0:1789185736.593201:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7936b5d500 x1876096821851008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185736.593210:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821851008:0@lo:400:kworker.0 00000100:00100000:1.0:1789185736.593219:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58cff117-25e2-45dd-b12f-8a52f6f341b2:3278:1876096821850880:0@lo:400:kworker.0 00010000:00010000:0.0:1789185737.622889:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185738.582989:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185723/real 1789185723] req@ffff9c7936b5e300 x1876096821847040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185738 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185738.583039:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7936b5e300 x1876096821847040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185738 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185738.583052:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185723/real 1789185723] req@ffff9c7936b5ca80 x1876096821847168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185738 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185738.583064:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7936b5ca80 x1876096821847168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185738 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789185738.584035:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c79405c4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789185738.584202:0:3277:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789185738.584210:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821847040:0@lo:8:kworker.0 00000100:00080000:1.0:1789185738.584218:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c7905456800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789185738.587458:0:3277:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789185738.587471:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821847168:0@lo:8:kworker.0 00000100:00100000:1.0:1789185738.587726:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58cff117-25e2-45dd-b12f-8a52f6f341b2:3281:1876096821851264:0@lo:400:kworker.0 00000100:00100000:1.0:1789185738.587809:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789185738.587934:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185738.587941:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789185738.587959:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c79405c4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789185738.587966:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 420 00000100:00080000:3.0:1789185738.587973:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789185738.587985:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c79405c4000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789185738.588012:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c793fc85180 x1876096821851392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789185738.588029:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185738.588032:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789185738.588034:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7905456800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789185738.588038:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 420 00000100:00080000:3.0:1789185738.588040:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789185738.588045:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7905456800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789185738.588057:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c793fc85500 x1876096821851520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789185738.588664:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821851264 00000100:00100000:0.0:1789185738.588678:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821851264 00000100:00100000:0.0:1789185738.588988:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789185738.589003:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:3281:x1876096821851264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.589102:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:3281:x1876096821851264:12345-0@lo:400:kworker.0 Request processed in 104us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185738.589561:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58cff117-25e2-45dd-b12f-8a52f6f341b2:3281:1876096821851264:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.589646:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789185738.590095:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821851648:0@lo:400:kworker.0 00000100:00100000:3.0:1789185738.590338:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185738.590385:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185738.590393:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821851776:0@lo:400:kworker.0 00000100:00100000:3.0:1789185738.590448:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185738.590511:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821851392:0@lo:8:kworker.0 00000100:00100000:3.0:1789185738.590544:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185738.590591:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821851520:0@lo:8:kworker.0 00000100:00100000:3.0:1789185738.590619:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185738.590783:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821851392 00000100:00100000:3.0:1789185738.590793:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821851392 00000100:00100000:3.0:1789185738.590839:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821851520 00000100:00100000:3.0:1789185738.590842:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821851520 00000100:00100000:3.0:1789185738.590854:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789185738.590861:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3277:x1876096821851392:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789185738.590992:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821851648 00000100:00100000:1.0:1789185738.590998:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821851648 00000100:00100000:1.0:1789185738.591037:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821851776 00000100:00100000:1.0:1789185738.591040:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821851776 00000100:00100000:1.0:1789185738.591071:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789185738.591078:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821851648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185738.591316:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821851648:12345-0@lo:400:kworker.0 Request processed in 238us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185738.591325:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789185738.591344:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185738.591351:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821851776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185738.591381:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821851776:12345-0@lo:400:kworker.0 Request processed in 31us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185738.591388:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789185738.591432:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789185738.591669:0:15069:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:3.0:1789185738.591816:0:15069:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x532743011272cb17 00002000:00100000:3.0:1789185738.591834:0:15069:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c793760c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789185738.591839:0:15069:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789185738.591842:0:15069:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1789185738.592537:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c793fc87800 x1876096821851776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185738.592560:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821851776:0@lo:400:kworker.0 00010000:00080000:0.0:1789185738.592576:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c793fc85c00 x1876096821851648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185738.592584:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821851648:0@lo:400:kworker.0 00002000:00080000:3.0:1789185738.594328:0:15069:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789185738.594377:0:15069:0:(import.c:65:import_set_state_nolock()) ffff9c793760b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185738.594706:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3277:x1876096821851392:12345-0@lo:8:kworker.0 Request processed in 3841us (4157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185738.594718:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789185738.594757:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185738.594764:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3277:x1876096821851520:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789185738.594785:0:15069:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789185738.594820:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3277:x1876096821851520:12345-0@lo:8:kworker.0 Request processed in 55us (4200us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789185738.594826:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789185738.597418:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c793fc85180 x1876096821851392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789185758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185738.597438:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789185738.597451:0:3277:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789185738.597462:0:3277:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789185738.597470:0:3277:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789185738.597482:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c79405c4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789185738.597615:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789185738.597625:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821851392:0@lo:8:kworker.0 00000100:00080000:1.0:1789185738.597645:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c7905456800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789185738.597650:0:3277:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789185738.597653:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821851520:0@lo:8:kworker.0 00000004:00080000:0.0:1789185738.597720:0:14408:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789185738.598569:0:14408:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 435638161697ns, next at 0ns, rc = 0 00000004:00080000:3.0:1789185738.602082:0:14409:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1789185738.602394:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14409:1876096821852032:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789185738.602529:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185738.602576:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7918b3df00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185738.602601:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821851904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185738.602630:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185738.602705:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821851904 00000100:00100000:3.0:1789185738.602715:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821851904 00000100:00100000:3.0:1789185738.602783:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789185738.602794:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876096821851904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185738.602839:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185738.602999:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821852032 00000100:00100000:1.0:1789185738.603004:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821852032 00000100:00100000:1.0:1789185738.603038:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789185738.603046:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14409:x1876096821852032:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789185738.606096:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1876096821851904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3294us (3455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185738.606116:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789185738.606381:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789185738.606452:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c793fc86d80 x1876096821851904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185738.606496:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821851904:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1789185738.615799:0:15068:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789185738.615812:0:15068:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789185738.615818:0:15068:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1789185738.627858:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.629001:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c741ae96/0x532743011272cb1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.629026:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.629032:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.629040:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c741ae96/0x532743011272cb1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.629076:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c741ae96/0x532743011272cb1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.629087:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c741ae96/0x532743011272cb1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.629095:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c741ae96/0x532743011272cb1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.629142:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185738.629164:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185738.629169:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c741ae96/0x532743011272cb1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.629175:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c600 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185738.629179:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c741ae96/0x532743011272cb1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.629187:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c741ae96/0x532743011272cb1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.629203:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c741ae96/0x532743011272cb1e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.629207:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c741ae96/0x532743011272cb1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.629598:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.629601:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.629603:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185738.630569:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.630580:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003018101/0x532743011272cb25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.630595:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.630600:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.630606:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003018101/0x532743011272cb25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.630618:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003018101/0x532743011272cb25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.630626:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003018101/0x532743011272cb25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.630631:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003018101/0x532743011272cb25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.630699:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789185738.631285:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.631290:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272cb2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.631308:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.631311:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.631314:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272cb2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.631322:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272cb2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.631327:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272cb2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.631333:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272cb2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.631399:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185738.631419:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003018101/0x532743011272cb25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.631426:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c400 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185738.631430:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003018101/0x532743011272cb25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.631440:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003018101/0x532743011272cb25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.631464:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003018101/0x532743011272cb25 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.631472:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003018101/0x532743011272cb25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.631511:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185738.631513:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272cb2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.631519:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4c200 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185738.631521:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272cb2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.631526:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272cb2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.631532:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272cb2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.631537:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185738.631538:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185738.631540:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.633952:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789185738.633970:0:15068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ace09616/0x532743011272cb2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.634278:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185738.640554:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185738.643900:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.643921:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6dccfca/0x532743011272cb33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.643945:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.643951:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.643960:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6dccfca/0x532743011272cb33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.643994:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6dccfca/0x532743011272cb33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.644008:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6dccfca/0x532743011272cb33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.644017:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6dccfca/0x532743011272cb33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.644046:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185738.644293:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185738.644301:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6dccfca/0x532743011272cb33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.644307:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4dc00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185738.644311:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6dccfca/0x532743011272cb33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.644328:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6dccfca/0x532743011272cb33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.644345:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6dccfca/0x532743011272cb33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.644349:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6dccfca/0x532743011272cb33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185738.644373:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185738.644375:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185738.644377:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185738.646821:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.646838:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000836a0cd0/0x532743011272cb3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.646859:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.646864:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.646872:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000836a0cd0/0x532743011272cb3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.646888:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000836a0cd0/0x532743011272cb3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.646899:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000836a0cd0/0x532743011272cb3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.646921:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000836a0cd0/0x532743011272cb3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.646945:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185738.646961:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185738.646968:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000836a0cd0/0x532743011272cb3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.646977:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d200 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185738.646983:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000836a0cd0/0x532743011272cb3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.646993:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000836a0cd0/0x532743011272cb3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.647014:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000836a0cd0/0x532743011272cb3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.647022:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000836a0cd0/0x532743011272cb3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.647046:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.647048:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.647050:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185738.650380:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.650448:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc10737f/0x532743011272cb41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.650471:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.650486:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.650494:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc10737f/0x532743011272cb41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.650513:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc10737f/0x532743011272cb41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.650525:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc10737f/0x532743011272cb41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.650535:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc10737f/0x532743011272cb41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.650567:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789185738.651018:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.651026:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba1b3f24/0x532743011272cb48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.651036:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.651040:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.651044:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba1b3f24/0x532743011272cb48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.651055:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba1b3f24/0x532743011272cb48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.651070:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba1b3f24/0x532743011272cb48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.651078:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba1b3f24/0x532743011272cb48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.651102:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789185738.651124:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789185738.651371:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185738.651571:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185738.651580:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba1b3f24/0x532743011272cb48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.651603:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d400 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185738.651609:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba1b3f24/0x532743011272cb48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.651620:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba1b3f24/0x532743011272cb48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.651645:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba1b3f24/0x532743011272cb48 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.651651:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba1b3f24/0x532743011272cb48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.651675:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185738.651676:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185738.651678:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185738.651683:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185738.651685:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.654336:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc10737f/0x532743011272cb41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.654364:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d600 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185738.654372:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc10737f/0x532743011272cb41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.654384:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc10737f/0x532743011272cb41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.654436:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc10737f/0x532743011272cb41 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.654445:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc10737f/0x532743011272cb41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.654493:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.654516:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.654519:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185738.658104:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.658125:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b74e754a/0x532743011272cb4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.658150:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.658156:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.658164:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b74e754a/0x532743011272cb4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.658183:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b74e754a/0x532743011272cb4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.658196:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b74e754a/0x532743011272cb4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.658205:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b74e754a/0x532743011272cb4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.658239:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185738.658258:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185738.658264:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b74e754a/0x532743011272cb4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.658272:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d000 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185738.658277:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b74e754a/0x532743011272cb4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.658300:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b74e754a/0x532743011272cb4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.658321:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b74e754a/0x532743011272cb4f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.658330:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b74e754a/0x532743011272cb4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.658354:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.658356:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.658358:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185738.661357:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.661378:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000de0b120/0x532743011272cb56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.661402:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.661444:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.661453:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000de0b120/0x532743011272cb56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.661472:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000de0b120/0x532743011272cb56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.661496:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000de0b120/0x532743011272cb56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.661515:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000de0b120/0x532743011272cb56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.661545:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789185738.661966:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.661972:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272cb5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.661983:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.661986:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.661991:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272cb5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.662001:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272cb5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.662009:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272cb5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.662017:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272cb5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.662040:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789185738.662635:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185738.662647:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000de0b120/0x532743011272cb56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.662658:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4da00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185738.662664:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000de0b120/0x532743011272cb56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.662676:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000de0b120/0x532743011272cb56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.662703:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000de0b120/0x532743011272cb56 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.662725:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000de0b120/0x532743011272cb56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.662750:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185738.662753:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272cb5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.662760:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4ca00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185738.662763:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272cb5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.662770:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272cb5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.662779:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272cb5d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.662785:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aede85/0x532743011272cb5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.662797:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185738.662798:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185738.662800:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185738.663711:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.663724:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042fd7c4c/0x532743011272cb64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.663746:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.663750:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.663758:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042fd7c4c/0x532743011272cb64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.663772:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042fd7c4c/0x532743011272cb64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.663782:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042fd7c4c/0x532743011272cb64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.663790:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042fd7c4c/0x532743011272cb64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.663815:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789185738.664289:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.664299:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000798f2a15/0x532743011272cb6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.664309:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.664313:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.664317:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000798f2a15/0x532743011272cb6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.664326:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000798f2a15/0x532743011272cb6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.664345:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000798f2a15/0x532743011272cb6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.664352:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000798f2a15/0x532743011272cb6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.664378:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789185738.664398:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789185738.664440:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042fd7c4c/0x532743011272cb64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.664448:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4ce00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185738.664453:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042fd7c4c/0x532743011272cb64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.664462:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042fd7c4c/0x532743011272cb64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.664750:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185738.664758:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000798f2a15/0x532743011272cb6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.664767:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ed600 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185738.664770:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000798f2a15/0x532743011272cb6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.664790:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000798f2a15/0x532743011272cb6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.664806:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000798f2a15/0x532743011272cb6b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.664812:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000798f2a15/0x532743011272cb6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.664839:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185738.664841:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185738.664843:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.665080:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042fd7c4c/0x532743011272cb64 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.665090:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042fd7c4c/0x532743011272cb64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.665118:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.665126:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.665272:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.665287:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185738.665947:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.665956:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065b284f4/0x532743011272cb72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.665970:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.665974:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.665982:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065b284f4/0x532743011272cb72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.665996:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065b284f4/0x532743011272cb72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.666005:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065b284f4/0x532743011272cb72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.666013:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065b284f4/0x532743011272cb72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.666038:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789185738.666350:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185738.666358:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065b284f4/0x532743011272cb72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.666367:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ec400 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185738.666371:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065b284f4/0x532743011272cb72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.666379:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065b284f4/0x532743011272cb72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.666394:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065b284f4/0x532743011272cb72 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.666430:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065b284f4/0x532743011272cb72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.666454:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185738.666456:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185738.666457:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185738.670866:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.670887:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cb79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.670911:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.670916:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.670933:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cb79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.670953:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cb79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.670967:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cb79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.670976:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cb79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.671000:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185738.671025:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185738.671032:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cb79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.671040:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013eca00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185738.671045:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cb79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.671054:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cb79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.671072:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cb79 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.671092:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cb79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.674488:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.674499:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.674502:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185738.675936:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.675952:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002081d012/0x532743011272cb80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.675974:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.675980:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.675988:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002081d012/0x532743011272cb80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.676007:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002081d012/0x532743011272cb80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.676019:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002081d012/0x532743011272cb80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.676028:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002081d012/0x532743011272cb80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.676053:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789185738.680864:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.680887:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cb87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.680908:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.680914:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.680922:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cb87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.680939:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cb87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.680952:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cb87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.680960:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cb87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.680998:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789185738.681726:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.681737:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cb8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.681752:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.681755:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.681760:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cb8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.681772:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cb8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.681792:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cb8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.681799:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cb8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.681825:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789185738.681850:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789185738.681859:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002081d012/0x532743011272cb80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.681868:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ec600 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185738.681874:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002081d012/0x532743011272cb80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.681885:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002081d012/0x532743011272cb80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.681906:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002081d012/0x532743011272cb80 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.681914:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002081d012/0x532743011272cb80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.681937:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789185738.681947:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cb87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.681954:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ece00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185738.681958:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cb87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.681966:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cb87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.681978:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cb87 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.681985:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cb87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.681997:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185738.682001:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cb8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.682007:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013eda00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185738.682010:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cb8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.682017:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cb8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.682038:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cb8e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.682045:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cb8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.682062:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.682064:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.682066:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185738.682316:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185738.683302:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.683315:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000198fcf7f/0x532743011272cb95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.683332:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.683335:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.683341:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000198fcf7f/0x532743011272cb95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.683354:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000198fcf7f/0x532743011272cb95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.683364:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000198fcf7f/0x532743011272cb95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.683373:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000198fcf7f/0x532743011272cb95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.683959:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789185738.687919:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.687936:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000846fb101/0x532743011272cb9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.687959:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.687964:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.687972:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000846fb101/0x532743011272cb9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.687989:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000846fb101/0x532743011272cb9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.688001:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000846fb101/0x532743011272cb9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.688010:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000846fb101/0x532743011272cb9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.689503:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185738.689521:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000198fcf7f/0x532743011272cb95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.689565:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ec800 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185738.689571:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000198fcf7f/0x532743011272cb95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.689583:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000198fcf7f/0x532743011272cb95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.689610:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000198fcf7f/0x532743011272cb95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.689618:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000198fcf7f/0x532743011272cb95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.690085:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185738.690240:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185738.690247:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000846fb101/0x532743011272cb9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.690258:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ed000 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185738.690262:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000846fb101/0x532743011272cb9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.690271:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000846fb101/0x532743011272cb9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.690287:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000846fb101/0x532743011272cb9c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.690309:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000846fb101/0x532743011272cb9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.690333:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185738.690335:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185738.690337:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185738.690501:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185738.690503:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185738.690505:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185738.695896:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.695919:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cba3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.695943:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.695957:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.695965:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.695984:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.695998:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.696006:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cba3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.696096:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789185738.696923:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.696934:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041aa535f/0x532743011272cbaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.696948:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.696952:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.696957:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041aa535f/0x532743011272cbaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.696970:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041aa535f/0x532743011272cbaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.696979:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041aa535f/0x532743011272cbaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.696994:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041aa535f/0x532743011272cbaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.697024:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789185738.697043:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789185738.697051:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cba3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.697061:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013eca00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185738.697066:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cba3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.697077:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cba3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.697099:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cba3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.697122:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075e5293a/0x532743011272cba3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.699487:0:15669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185738.699507:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041aa535f/0x532743011272cbaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.699524:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ed200 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185738.699530:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041aa535f/0x532743011272cbaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.699541:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041aa535f/0x532743011272cbaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.699569:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041aa535f/0x532743011272cbaa lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.699578:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041aa535f/0x532743011272cbaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.702077:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789185738.705630:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789185738.705649:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f16ac7/0x532743011272cbb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.705677:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1789185738.705682:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185738.705691:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036f16ac7/0x532743011272cbb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.705709:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036f16ac7/0x532743011272cbb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.705721:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f16ac7/0x532743011272cbb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.705729:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036f16ac7/0x532743011272cbb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.705759:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185738.705775:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1789185738.706227:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789185738.706235:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005af1dcd4/0x532743011272cbb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.706247:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1789185738.706250:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185738.706254:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005af1dcd4/0x532743011272cbb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.706264:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005af1dcd4/0x532743011272cbb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.706272:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005af1dcd4/0x532743011272cbb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.706279:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005af1dcd4/0x532743011272cbb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.706287:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789185738.706755:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789185738.706763:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2aa3d3d/0x532743011272cbbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.706774:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1789185738.706784:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185738.706790:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2aa3d3d/0x532743011272cbbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.706801:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2aa3d3d/0x532743011272cbbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.706810:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2aa3d3d/0x532743011272cbbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.706818:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2aa3d3d/0x532743011272cbbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.706826:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789185738.707234:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789185738.707241:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003389b333/0x532743011272cbc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.707250:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1789185738.707253:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185738.707258:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003389b333/0x532743011272cbc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.707268:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003389b333/0x532743011272cbc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.707277:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003389b333/0x532743011272cbc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.707291:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003389b333/0x532743011272cbc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.707299:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789185738.708558:0:15669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789185738.708574:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005af1dcd4/0x532743011272cbb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.708607:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355800 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185738.708614:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005af1dcd4/0x532743011272cbb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.708628:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005af1dcd4/0x532743011272cbb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.708658:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005af1dcd4/0x532743011272cbb8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.708667:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005af1dcd4/0x532743011272cbb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.708688:0:15669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789185738.708692:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2aa3d3d/0x532743011272cbbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.708699:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354200 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185738.708702:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2aa3d3d/0x532743011272cbbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.708709:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2aa3d3d/0x532743011272cbbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.708718:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2aa3d3d/0x532743011272cbbf lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.708731:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2aa3d3d/0x532743011272cbbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.708742:0:15669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185738.708746:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003389b333/0x532743011272cbc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.708752:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354a00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185738.708754:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003389b333/0x532743011272cbc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.708761:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003389b333/0x532743011272cbc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.708770:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003389b333/0x532743011272cbc6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.708778:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003389b333/0x532743011272cbc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.708789:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185738.708791:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185738.708793:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.711268:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.711277:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.711280:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789185738.713794:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789185738.713810:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014050d59/0x532743011272cbcd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.713835:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1789185738.713842:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185738.713850:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014050d59/0x532743011272cbcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.713868:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014050d59/0x532743011272cbcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.713880:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014050d59/0x532743011272cbcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.713888:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014050d59/0x532743011272cbcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.713916:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185738.713937:0:15669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185738.713944:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014050d59/0x532743011272cbcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.713961:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355a00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185738.713966:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014050d59/0x532743011272cbcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.713976:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014050d59/0x532743011272cbcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.713995:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014050d59/0x532743011272cbcd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.714003:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014050d59/0x532743011272cbcd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.714025:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185738.714027:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185738.714029:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.714672:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.714686:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036f16ac7/0x532743011272cbb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.714706:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355c00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185738.714710:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f16ac7/0x532743011272cbb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.714718:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f16ac7/0x532743011272cbb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.714733:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036f16ac7/0x532743011272cbb1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.714740:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036f16ac7/0x532743011272cbb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.714759:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.714761:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.714763:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.714768:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185738.714770:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185738.717730:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.717748:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cbd4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.717770:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.717776:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.717783:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cbd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.717818:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cbd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.717831:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cbd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.717840:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cbd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.717869:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185738.718425:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185738.718436:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cbd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.718446:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013eda00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185738.718451:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cbd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.718462:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cbd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.718507:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cbd4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.718515:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dfd67bf/0x532743011272cbd4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185738.718549:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185738.718552:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185738.718554:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185738.718988:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185738.718995:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cbdb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.719008:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789185738.719012:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185738.719018:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cbdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.719031:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cbdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.719041:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cbdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.719063:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cbdb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185738.719086:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789185738.719802:0:15669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185738.719815:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cbdb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.719836:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ece00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185738.719841:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cbdb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.719852:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cbdb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.719873:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cbdb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.719880:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb47d15e/0x532743011272cbdb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185738.719901:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185738.719903:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185738.719904:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789185738.720852:0:15068:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1789185738.721013:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14409:x1876096821852032:12345-0@lo:5:osp-pre-0-0.0 Request processed in 117961us (118477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185738.721026:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789185738.721212:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14409:1876096821852032:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789185738.721444:0:14409:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789185738.721522:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14409:1876096821852160:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789185738.721635:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185738.721694:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906537480 going to sleep for 11 seconds 00000100:00100000:2.0:1789185738.721779:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821852160 00000100:00100000:2.0:1789185738.721788:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821852160 00000100:00100000:2.0:1789185738.721847:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789185738.721859:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14409:x1876096821852160:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789185738.721911:0:15069:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1789185738.743585:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14409:x1876096821852160:12345-0@lo:5:osp-pre-0-0.0 Request processed in 21712us (21935us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789185738.743603:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185738.746883:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14409:1876096821852160:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789185738.746912:0:14409:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:1.0:1789185738.749310:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1789185739.663632:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185740.690054:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789185741.221323:0:15790:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789185741.221328:0:15790:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789185741.222178:0:15790:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c791f9a0800 00000020:01000004:2.0:1789185741.222205:0:15790:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789185741.222224:0:15790:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789185741.222243:0:15790:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c7907230000) 00000020:00000080:2.0:1789185741.222265:0:15790:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789185741.266518:0:15790:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789185741.266850:0:15790:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789185741.267683:0:15790:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789185741.267926:0:15790:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789185741.268163:0:15790:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789185741.270859:0:15790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 519: rc = 0 00100000:10000000:3.0:1789185741.271260:0:15790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 519: rc = 0 00100000:10000000:3.0:1789185741.271364:0:15790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 519: rc = 0 00100000:10000000:3.0:1789185741.272231:0:15790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 57: rc = 0 00100000:10000000:3.0:1789185741.272532:0:15790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 57: rc = 0 00100000:10000000:3.0:1789185741.273348:0:15790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 57: rc = 0 00100000:10000000:3.0:1789185741.273600:0:15790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 57: rc = 0 00100000:10000000:3.0:1789185741.280260:0:15790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 57: rc = 0 00100000:10000000:3.0:1789185741.282254:0:15790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 57: rc = 0 00000020:00000080:3.0:1789185741.283312:0:15790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789185741.283330:0:15790:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789185741.283348:0:15790:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x532743011272cbe9 00000020:01000004:3.0:1789185741.283362:0:15790:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789185741.283390:0:15790:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789185741.283394:0:15790:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789185741.283401:0:15790:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789185741.283530:0:15790:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789185741.283536:0:15790:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789185741.305729:0:15790:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789185741.305796:0:15790:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.154@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789185741.305802:0:15790:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789185741.305804:0:15790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789185741.305806:0:15790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185741.305807:0:15790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185741.305808:0:15790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185741.305809:0:15790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185741.305811:0:15790:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789185741.305813:0:15790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185741.305814:0:15790:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789185741.305819:0:15790:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789185741.305821:0:15790:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789185741.305822:0:15790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789185741.305824:0:15790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185741.307315:0:15790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185741.307318:0:15790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185741.307321:0:15790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185741.307323:0:15790:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789185741.307325:0:15790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185741.307326:0:15790:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789185741.307382:0:15790:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789185741.307901:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc86d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821852288:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789185741.308149:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185741.308226:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79034f7840 going to sleep for 11 seconds 00000100:00100000:0.0:1789185741.308370:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821852288 00000100:00100000:0.0:1789185741.308382:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821852288 00000100:00100000:0.0:1789185741.308497:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789185741.308510:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:15790:x1876096821852288:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789185741.308552:0:14380:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789185741.308556:0:14380:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789185741.308560:0:14380:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789185741.334248:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:15790:x1876096821852288:12345-0@lo:253:mount.lustre.0 Request processed in 25726us (26085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185741.334270:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789185741.334573:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc86d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821852288:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789185741.334595:0:15790:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789185741.334599:0:15790:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789185741.334608:0:15790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789185741.334610:0:15790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789185741.334611:0:15790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789185741.334613:0:15790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789185741.334614:0:15790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789185741.334615:0:15790:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789185741.334618:0:15790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789185741.334620:0:15790:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789185741.334722:0:15790:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c791f9a0800 from lustre-OST0001 10000000:01000000:0.0:1789185741.334760:0:15790:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789185741.334764:0:15790:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789185741.334774:0:15790:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c792f804d40 local copy 00010000:00010000:0.0:1789185741.334787:0:15790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272c98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272c996 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185741.335922:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821852416:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185741.336197:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185741.336335:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906537480 going to sleep for 11 seconds 00000100:00100000:3.0:1789185741.336718:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821852416 00000100:00100000:3.0:1789185741.336728:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821852416 00000100:00100000:0.0:1789185741.336962:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789185741.336973:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:15790:x1876096821852416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185741.338384:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:15790:x1876096821852416:12345-0@lo:501:mount.lustre.0 Request processed in 1403us (2179us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789185741.338399:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789185741.338787:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821852416:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789185741.338817:0:15790:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789185741.339332:0:15790:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789185741.339345:0:15790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272c98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272c996 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.339358:0:15790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c793fe04600/0x532743011272c98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272c996 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185741.339394:0:15790:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c791f9a0800 10000000:01000000:3.0:1789185741.339400:0:15790:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789185741.339433:0:15790:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789185741.339704:0:15790:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789185741.339712:0:15790:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789185741.339715:0:15790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789185741.339770:0:15790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272cbf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.339780:0:15790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272cbf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.339793:0:15790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272cbf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185741.339822:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821852544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789185741.340157:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185741.340220:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79034f7300 going to sleep for 11 seconds 00000100:00100000:0.0:1789185741.340357:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821852544 00000100:00100000:0.0:1789185741.340366:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821852544 00000100:00100000:0.0:1789185741.340520:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789185741.340532:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:15790:x1876096821852544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185741.340549:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185741.340567:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7907354800/0x532743011272cbf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272cbf0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.340612:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7907354800/0x532743011272cbf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272cbf0 expref: 17 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.340625:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7907354800/0x532743011272cbf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272cbf0 expref: 17 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.340712:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354800, rc 0) 00000100:00100000:0.0:1789185741.340774:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:15790:x1876096821852544:12345-0@lo:101:mount.lustre.0 Request processed in 245us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185741.340783:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789185741.342850:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821852544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185741.342887:0:15790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272cbf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cbf7 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.342902:0:15790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272cbf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272cbf7 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789185741.343856:0:15790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789185741.344907:0:15790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789185741.345209:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789185741.345257:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789185741.345290:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789185741.345334:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789185741.345370:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789185741.345443:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789185741.345524:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789185741.345533:0:15790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789185741.345641:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821852672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185741.345729:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185741.351241:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79034f76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185741.352316:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821852672 00000100:00100000:2.0:1789185741.352333:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821852672 00000100:00100000:0.0:1789185741.353841:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789185741.353858:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:15790:x1876096821852672:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185741.355506:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:15790:x1876096821852672:12345-0@lo:501:mount.lustre.0 Request processed in 1641us (9765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185741.355522:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789185741.360099:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821852672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185741.360198:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821852800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789185741.360306:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185741.360365:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7936b51b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185741.360649:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821852800 00000100:00100000:1.0:1789185741.360660:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821852800 00000100:00100000:1.0:1789185741.360745:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789185741.360757:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:15790:x1876096821852800:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789185741.361218:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:15790:x1876096821852800:12345-0@lo:503:mount.lustre.0 Request processed in 459us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185741.361227:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789185741.361305:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821852800:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789185741.362487:0:15790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789185741.362593:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821852928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185741.362666:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185741.362725:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821852928 00000100:00100000:1.0:1789185741.362732:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821852928 00000100:00100000:1.0:1789185741.362768:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789185741.362777:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:15790:x1876096821852928:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185741.362999:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:15790:x1876096821852928:12345-0@lo:502:mount.lustre.0 Request processed in 222us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185741.363007:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789185741.363065:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c793f51e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185741.363087:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821852928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789185741.363357:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789185741.363432:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789185741.374425:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789185741.374560:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789185741.374595:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789185741.374630:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789185741.374833:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789185741.374868:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789185741.374917:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789185741.374979:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185741.375098:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185741.375163:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c793f51e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185741.376560:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821853056 00000100:00100000:2.0:1789185741.376578:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821853056 00000100:00100000:2.0:1789185741.376672:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789185741.376685:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:15790:x1876096821853056:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789185741.377044:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:15790:x1876096821853056:12345-0@lo:502:mount.lustre.0 Request processed in 361us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185741.377054:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789185741.377543:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789185741.377700:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789185741.377720:0:15790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1789185741.389215:0:15791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789185741.389233:0:15791:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789185741.389242:0:15791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185741.389245:0:15791:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789185741.389255:0:15791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789185741.389277:0:15791:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c790661cd40) 00000020:00000080:0.0:1789185741.389307:0:15791:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789185741.389316:0:15791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789185741.389395:0:15791:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c791f9a0800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789185741.389429:0:15791:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789185741.389438:0:15791:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x532743011272cc05 00010000:00010000:0.0:1789185741.399861:0:15791:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1789185741.400459:0:15791:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1789185741.405313:0:15791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789185741.407379:0:15791:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789185741.407397:0:15791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185741.407466:0:15791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185741.407469:0:15791:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789185741.407474:0:15791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185741.407480:0:15791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185741.407481:0:15791:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789185741.407485:0:15791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789185741.407487:0:15791:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789185741.407489:0:15791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185741.407492:0:15791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185741.407493:0:15791:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789185741.407496:0:15791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185741.407498:0:15791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185741.407499:0:15791:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789185741.407503:0:15791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789185741.407584:0:15791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185741.407588:0:15791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185741.407589:0:15791:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789185741.407594:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789185741.407860:0:15790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789185741.407898:0:15790:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789185741.407931:0:15790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272cbf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cbf7 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185741.407947:0:15790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c793fe05c00/0x532743011272cbf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cbf7 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185741.407976:0:15790:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c791f9a0800 from 1 10000000:01000000:1.0:1789185741.407980:0:15790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789185741.408031:0:15790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013ec600/0x532743011272cc0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185741.408041:0:15790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79013ec600/0x532743011272cc0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185741.408055:0:15790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79013ec600/0x532743011272cc0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185741.408090:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789185741.408181:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185741.408235:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c793f51e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185741.408564:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821853184 00000100:00100000:0.0:1789185741.408575:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821853184 00000100:00100000:0.0:1789185741.408630:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789185741.408653:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:15790:x1876096821853184:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185741.408674:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185741.408693:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7907354600/0x532743011272cc13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272cc0c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.408727:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7907354600/0x532743011272cc13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272cc0c expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.408739:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7907354600/0x532743011272cc13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272cc0c expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.408760:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354600, rc 0) 00000100:00100000:0.0:1789185741.408825:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:15790:x1876096821853184:12345-0@lo:101:mount.lustre.0 Request processed in 176us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185741.408833:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789185741.409002:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185741.409020:0:15790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79013ec600/0x532743011272cc0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cc13 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.409030:0:15790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79013ec600/0x532743011272cc0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272cc13 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789185741.409719:0:15790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789185741.410082:0:15790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789185741.410387:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789185741.410492:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789185741.410588:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789185741.410597:0:15790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789185741.410701:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185741.410768:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185741.410825:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821853312 00000100:00100000:3.0:1789185741.410832:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821853312 00000100:00100000:3.0:1789185741.410878:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789185741.410887:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:15790:x1876096821853312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185741.411109:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:15790:x1876096821853312:12345-0@lo:501:mount.lustre.0 Request processed in 222us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185741.411117:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789185741.411167:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79034f70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185741.411191:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185741.411224:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853440:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789185741.411265:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185741.411287:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821853440 00000100:00100000:3.0:1789185741.411291:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821853440 00000100:00100000:3.0:1789185741.411313:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789185741.411319:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:15790:x1876096821853440:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789185741.411641:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:15790:x1876096821853440:12345-0@lo:503:mount.lustre.0 Request processed in 322us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185741.411647:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789185741.411675:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79034f70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185741.411684:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853440:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789185741.412214:0:15790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789185741.412280:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185741.412322:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185741.412357:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821853568 00000100:00100000:3.0:1789185741.412361:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821853568 00000100:00100000:3.0:1789185741.412389:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789185741.412397:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:15790:x1876096821853568:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185741.418392:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:15790:x1876096821853568:12345-0@lo:502:mount.lustre.0 Request processed in 5985us (6059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185741.418564:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789185741.425585:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79034f70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185741.425660:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789185741.426100:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789185741.426182:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789185741.426233:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789185741.426272:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789185741.426304:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789185741.426350:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789185741.426384:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789185741.426469:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789185741.426532:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185741.426632:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185741.426686:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79034f70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185741.426726:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821853696 00000100:00100000:2.0:1789185741.426735:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821853696 00000100:00100000:2.0:1789185741.426809:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789185741.426907:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:15790:x1876096821853696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185741.430112:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:15790:x1876096821853696:12345-0@lo:502:mount.lustre.0 Request processed in 3269us (3463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185741.430132:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789185741.430400:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789185741.431604:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789185741.431713:0:15790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789185741.433050:0:15795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185741.433066:0:15795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185741.433069:0:15795:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789185741.433078:0:15795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c791f9a0800 00000020:00000080:0.0:1789185741.433082:0:15795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789185741.433091:0:15795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185741.433093:0:15795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185741.433095:0:15795:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789185741.433097:0:15795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185741.433100:0:15795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185741.433101:0:15795:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789185741.433105:0:15795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c791f9a0800 00000020:00000080:0.0:1789185741.433107:0:15795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789185741.433182:0:15795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185741.433186:0:15795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185741.433188:0:15795:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789185741.433190:0:15795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185741.433193:0:15795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185741.433194:0:15795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789185741.433198:0:15795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c791f9a0800 00000020:00000080:0.0:1789185741.433200:0:15795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789185741.433235:0:15795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185741.433239:0:15795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185741.433241:0:15795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789185741.433245:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789185741.440243:0:15790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789185741.440303:0:15790:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789185741.440342:0:15790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013ec600/0x532743011272cc0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cc13 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185741.440364:0:15790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79013ec600/0x532743011272cc0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cc13 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185741.443898:0:15790:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789185741.443913:0:15790:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c791f9a0800 10000000:01000000:3.0:1789185741.443918:0:15790:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c791f9a0800 10000000:01000000:3.0:1789185741.443923:0:15790:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789185741.443932:0:15790:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c791f9a0800 from 1 10000000:01000000:3.0:1789185741.443935:0:15790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789185741.443995:0:15790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04a00/0x532743011272cc1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.444010:0:15790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c793fe04a00/0x532743011272cc1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.444024:0:15790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c793fe04a00/0x532743011272cc1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185741.444057:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc87100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789185741.444153:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185741.444219:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821853824 00000100:00100000:3.0:1789185741.444230:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821853824 00000100:00100000:3.0:1789185741.444284:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789185741.444296:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7907cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:15790:x1876096821853824:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185741.444313:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185741.444330:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe04400/0x532743011272cc21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272cc1a expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.444360:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe04400/0x532743011272cc21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272cc1a expref: 19 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.444373:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe04400/0x532743011272cc21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272cc1a expref: 19 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.444393:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04400, rc 0) 00000100:00100000:3.0:1789185741.444464:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7907cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:15790:x1876096821853824:12345-0@lo:101:mount.lustre.0 Request processed in 170us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185741.444473:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789185741.444535:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7906b2ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185741.444563:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc87100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185741.444582:0:15790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c793fe04a00/0x532743011272cc1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cc21 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.444594:0:15790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c793fe04a00/0x532743011272cc1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272cc21 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789185741.449960:0:15790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1789185741.454167:0:15790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185741.455272:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789185741.455394:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789185741.455667:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789185741.455728:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789185741.455767:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789185741.456371:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789185741.456661:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789185741.456704:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789185741.456778:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789185741.456816:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789185741.457807:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789185741.458731:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789185741.458782:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789185741.458819:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789185741.459856:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789185741.459898:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789185741.459925:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789185741.459966:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789185741.460204:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789185741.460242:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789185741.460292:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789185741.460357:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789185741.460388:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789185741.460473:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789185741.460513:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789185741.460547:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789185741.462565:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789185741.464376:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789185741.464506:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789185741.464575:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1789185741.464604:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1789185741.464630:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1789185741.464656:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1789185741.464696:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1789185741.464723:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1789185741.464760:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1789185741.464787:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1789185741.464928:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1789185741.464936:0:15790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789185741.469358:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185741.470812:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185741.470903:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791187ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789185741.471705:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821853952 00000100:00100000:0.0:1789185741.471729:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821853952 00000100:00100000:0.0:1789185741.471800:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789185741.471813:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79188bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:15790:x1876096821853952:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185741.472212:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79188bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:15790:x1876096821853952:12345-0@lo:501:mount.lustre.0 Request processed in 400us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185741.472222:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789185741.472454:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821853952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185741.472523:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821854080:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789185741.472579:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185741.474887:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791035b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185741.483708:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821854080 00000100:00100000:2.0:1789185741.483733:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821854080 00000100:00100000:2.0:1789185741.484358:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789185741.484378:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79188ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:15790:x1876096821854080:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789185741.486167:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79188ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:15790:x1876096821854080:12345-0@lo:503:mount.lustre.0 Request processed in 1785us (13577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185741.486183:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789185741.487248:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821854080:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789185741.488275:0:15790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789185741.488394:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821854208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789185741.488548:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185741.488609:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821854208 00000100:00100000:0.0:1789185741.488619:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821854208 00000100:00100000:0.0:1789185741.488675:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789185741.499244:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79188b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:15790:x1876096821854208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789185741.499515:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7918b3d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185741.499996:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79188b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:15790:x1876096821854208:12345-0@lo:502:mount.lustre.0 Request processed in 11307us (11443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185741.500009:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789185741.500062:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821854208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789185741.500552:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789185741.500622:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789185741.500658:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789185741.500708:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789185741.500745:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789185741.500805:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789185741.500860:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789185741.500889:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789185741.500934:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789185741.500972:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789185741.501009:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789185741.501058:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789185741.501096:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789185741.501131:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789185741.501179:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789185741.501215:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789185741.501247:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789185741.501317:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789185741.501354:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789185741.501385:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789185741.501494:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789185741.501536:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789185741.501571:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789185741.501622:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789185741.501660:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789185741.501696:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789185741.501748:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789185741.501786:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789185741.501821:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789185741.501871:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789185741.501908:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789185741.501938:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789185741.501972:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789185741.502040:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789185741.502073:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789185741.502141:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789185741.502177:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789185741.502212:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789185741.502261:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789185741.502311:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789185741.502375:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821854336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789185741.502515:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185741.502572:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791187ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185741.502660:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821854336 00000100:00100000:3.0:1789185741.502671:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821854336 00000100:00100000:3.0:1789185741.502740:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789185741.502751:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79188bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:15790:x1876096821854336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185741.503054:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79188bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:15790:x1876096821854336:12345-0@lo:502:mount.lustre.0 Request processed in 304us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185741.503064:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789185741.505111:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821854336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789185741.505320:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789185741.505341:0:15790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789185741.513389:0:15800:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789185741.513786:0:15800:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c7906618000) 00000020:00000080:0.0:1789185741.513816:0:15800:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1789185741.513939:0:15800:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c791f9a0800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789185741.513945:0:15800:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c791f9a0800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789185741.513948:0:15800:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c791f9a0800 3 00010000:00080000:0.0:1789185741.513988:0:15800:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7803207000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.154@tcp at head 00010000:00010000:0.0:1789185741.516902:0:15800:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1789185741.517168:0:15800:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789185741.517216:0:15800:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789185741.517234:0:15800:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x532743011272cc2f 00000100:00080000:0.0:1789185741.517247:0:15800:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789185741.517261:0:15800:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c7803207000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:0.0:1789185741.517312:0:15800:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7936b5c700 x1876096821854464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789185741.517381:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1876096821854464:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789185741.517624:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789185741.517798:0:15800:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789185741.517893:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185741.517899:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789185741.517903:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7905456800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789185741.517909:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:3.0:1789185741.517915:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:2.0:1789185741.517917:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821854464 00000100:00100000:2.0:1789185741.517929:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821854464 00000100:00080000:3.0:1789185741.517943:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7905456800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:2.0:1789185741.517976:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789185741.517985:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1876096821854464:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789185741.518015:0:14386:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:2.0:1789185741.518049:0:14386:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x532743011272cc36 00000004:00100000:2.0:1789185741.518068:0:14386:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789185741.518111:0:14386:0:(import.c:65:import_set_state_nolock()) ffff9c78028d3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185741.518197:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821854592:0@lo:400:kworker.0 00000100:00100000:0.0:1789185741.518237:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185741.518328:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876096821854464:12345-0@lo:38:llog_process_th.0 Request processed in 341us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185741.518336:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:0.0:1789185741.518792:0:15800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789185741.518852:0:15790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789185741.518882:0:15790:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789185741.518901:0:15790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c793fe04a00/0x532743011272cc1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cc21 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.518914:0:15790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c793fe04a00/0x532743011272cc1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cc21 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789185741.518982:0:15790:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789185741.518984:0:15790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789185741.518986:0:15790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789185741.518991:0:15790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789185741.518993:0:15790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789185741.518994:0:15790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789185741.518996:0:15790:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789185741.518997:0:15790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789185741.518998:0:15790:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789185741.519003:0:15790:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789185741.519005:0:15790:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789185741.519006:0:15790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789185741.519007:0:15790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789185741.519008:0:15790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789185741.519009:0:15790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789185741.519010:0:15790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789185741.519010:0:15790:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789185741.519011:0:15790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789185741.519012:0:15790:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789185741.519031:0:15790:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789185741.519045:0:15790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821854720:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789185741.519102:0:15790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185741.519130:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821854720 00000100:00100000:0.0:1789185741.519136:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821854720 00000100:00100000:0.0:1789185741.519173:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789185741.519182:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79188bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:15790:x1876096821854720:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789185741.519226:0:14380:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789185741.519244:0:14380:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789185741.519746:0:15790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c78031ee900 going to sleep for 11 seconds 00000100:00100000:3.0:1789185741.520176:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c793fc84a80 x1876096821854848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789185741.520263:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821854976:0@lo:400:kworker.0 00000100:00100000:3.0:1789185741.520314:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185741.520351:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185741.520358:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821855104:0@lo:400:kworker.0 00000100:00100000:3.0:1789185741.520382:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185741.520527:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821854976 00000100:00100000:3.0:1789185741.520534:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821854976 00000100:00100000:3.0:1789185741.520584:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821855104 00000100:00100000:3.0:1789185741.520588:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821855104 00000100:00100000:2.0:1789185741.520671:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789185741.520681:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789185741.520686:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821854976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185741.520696:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821855104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185741.520757:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876096821855104:12345-0@lo:400:kworker.0 Request processed in 65us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185741.520761:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821854976:12345-0@lo:400:kworker.0 Request processed in 79us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185741.520770:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1789185741.520791:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789185741.520815:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c793fc84380 x1876096821855104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185741.520830:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1876096821855104:0@lo:400:kworker.0 00010000:00080000:3.0:1789185741.520841:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c793fc86680 x1876096821854976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185741.520849:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821854976:0@lo:400:kworker.0 00010000:00080000:1.0:1789185741.520934:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7936b5c700 x1876096821854464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185741.520945:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789185741.520969:0:3277:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789185741.520979:0:3277:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789185741.520985:0:3277:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789185741.520988:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c7803207000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789185741.520997:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1876096821854464:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789185741.521014:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821854848:0@lo:8:kworker.0 00000100:00100000:1.0:1789185741.521047:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185741.521361:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821854592 00000100:00100000:0.0:1789185741.521367:0:15070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821854592 00000100:00100000:2.0:1789185741.521548:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789185741.521576:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821854848 00000100:00100000:2.0:1789185741.521580:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821854848 00000100:00100000:2.0:1789185741.521598:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185741.521608:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3281:x1876096821854592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185741.521679:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3281:x1876096821854592:12345-0@lo:400:kworker.0 Request processed in 73us (3440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185741.521686:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185741.521711:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789185741.521715:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3277:x1876096821854848:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789185741.521772:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3277:x1876096821854848:12345-0@lo:8:kworker.0 Request processed in 54us (723us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789185741.521778:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789185741.521821:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185741.522003:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789185741.522011:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c7905456800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789185741.522015:0:3277:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789185741.522019:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821854848:0@lo:8:kworker.0 00000100:00100000:2.0:1789185741.525607:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821854592:0@lo:400:kworker.0 20000000:01000000:0.0:1789185741.546623:0:14380:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789185741.546657:0:14380:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789185741.546673:0:14402:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789185741.546681:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789185741.546713:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c79073ff400/0x532743011272cc3d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185741.546737:0:14402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c79073ff800/0x532743011272cb10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272cb09 expref: 19 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185741.546750:0:14402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c79073ff400/0x532743011272cc3d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185741.546813:0:14402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c79073ff800/0x532743011272cb10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272cb09 expref: 19 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185741.546833:0:14402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c79073ff800/0x532743011272cb10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272cb09 expref: 19 pid: 14381 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185741.546851:0:14402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14402:1876096821855232:0@lo:104: 00000100:00100000:2.0:1789185741.547304:0:14402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185741.547369:0:14402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791187a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789185741.547377:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821855232 00000100:00100000:1.0:1789185741.547389:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821855232 00000100:00100000:1.0:1789185741.547481:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789185741.547492:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58cff117-25e2-45dd-b12f-8a52f6f341b2+3:14402:x1876096821855232:12345-0@lo:104: 00010000:00010000:1.0:1789185741.547509:0:14370:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c7907355200/0x532743011272cb09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272cb10 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185741.547580:0:14370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789185741.547587:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58cff117-25e2-45dd-b12f-8a52f6f341b2+3:14402:x1876096821855232:12345-0@lo:104: Request processed in 97us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185741.547595:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789185741.547604:0:14402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14402:1876096821855232:0@lo:104: 00010000:00010000:2.0:1789185741.547631:0:14402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c79073ff400/0x532743011272cc3d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.547711:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185741.547722:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c7907355200/0x532743011272cb09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272cb10 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.547738:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355200 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:3.0:1789185741.547743:0:14375:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c7907355200/0x532743011272cb09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272cb10 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.547752:0:14375:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c7907355200/0x532743011272cb09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272cb10 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185741.547760:0:14375:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c7907355200/0x532743011272cb09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272cb10 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185741.547765:0:14375:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185741.547806:0:14375:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c7907355200/0x532743011272cb09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272cb10 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.547813:0:14375:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185741.547842:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c7907355200/0x532743011272cb09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272cb10 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185741.547850:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c7907355200/0x532743011272cb09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272cb10 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185741.547861:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58cff117-25e2-45dd-b12f-8a52f6f341b2:3280:1876096821855360:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185741.547871:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185741.547874:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185741.547876:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185741.548553:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185741.548776:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821855360 00000100:00100000:0.0:1789185741.548784:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821855360 00010000:00010000:0.0:1789185741.548818:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c79073ff800/0x532743011272cb10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272cb09 expref: 20 pid: 14381 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185741.548896:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789185741.548906:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58cff117-25e2-45dd-b12f-8a52f6f341b2+20:3280:x1876096821855360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185741.548924:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185741.548930:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c79073ff800/0x532743011272cb10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272cb09 expref: 20 pid: 14381 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.548945:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c79073ff800/0x532743011272cb10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272cb09 expref: 20 pid: 14381 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.548962:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79073ff800/0x532743011272cb10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272cb09 expref: 20 pid: 14381 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.548978:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c79073ff400/0x532743011272cc3d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.548987:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79073ff400/0x532743011272cc3d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789185741.549004:0:14373:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002324860s 00010000:00010000:0.0:1789185741.549010:0:14373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c79073ff400/0x532743011272cc3d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.549017:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c79073ff400/0x532743011272cc3d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.549024:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c79073ff400/0x532743011272cc3d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.549030:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c79073ff400/0x532743011272cc3d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.549043:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073ff400 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185741.549048:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c79073ff400/0x532743011272cc3d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.549056:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c79073ff400/0x532743011272cc3d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.549078:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c79073ff400/0x532743011272cc3d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185741.549090:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185741.549133:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:3280:x1876096821855360:12345-0@lo:103:ldlm_bl.0 Request processed in 229us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185741.549141:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789185741.549198:0:14402:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c79073ff400/0x532743011272cc3d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185741.549207:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c79073ff400/0x532743011272cc3d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185741.549223:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c79073ff400/0x532743011272cc3d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185741.549326:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58cff117-25e2-45dd-b12f-8a52f6f341b2:3280:1876096821855360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185741.553575:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79188bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:15790:x1876096821854720:12345-0@lo:253:mount.lustre.0 Request processed in 34379us (34458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185741.553595:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789185741.553602:0:15790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58cff117-25e2-45dd-b12f-8a52f6f341b2:15790:1876096821854720:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789185741.553628:0:15790:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789185741.553642:0:15790:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789185741.553645:0:15790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789185741.553647:0:15790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789185741.553648:0:15790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789185741.553650:0:15790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789185741.553651:0:15790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789185741.553652:0:15790:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789185741.553655:0:15790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789185741.553656:0:15790:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789185741.553677:0:15790:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789185741.564359:0:15790:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789185741.564819:0:15790:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789185741.564992:0:15790:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789185741.566155:0:15790:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789185741.566369:0:15790:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789185741.567184:0:15790:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789185741.568571:0:15790:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789185741.681822:0:15790:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789185741.681838:0:15790:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789185741.681892:0:15790:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789185741.681986:0:15790:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789185741.682008:0:15790:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789185741.682094:0:15790:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789185741.727361:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789185741.871423:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789185741.871442:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789185742.745697:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789185742.945848:0:14383:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789185742.945859:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c793f283000 from 8 10000000:01000000:0.0:1789185742.945867:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789185742.945996:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272cc44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.946011:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272cc44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.946025:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272cc44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185742.946059:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821855488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185742.946151:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185742.951371:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c791187ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185742.963631:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821855488 00000100:00100000:1.0:1789185742.963651:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821855488 00000100:00100000:1.0:1789185742.963746:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789185742.963758:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f658850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:14383:x1876096821855488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185742.963781:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185742.963807:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79013ed200/0x532743011272cc4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272cc44 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.963843:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79013ed200/0x532743011272cc4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272cc44 expref: 19 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.963856:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79013ed200/0x532743011272cc4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272cc44 expref: 19 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.963866:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013ed200, rc 0) 00000100:00100000:1.0:1789185742.964178:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f658850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:14383:x1876096821855488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 421us (18026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185742.964187:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789185742.971784:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821855488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185742.971829:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272cc44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cc4b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.971845:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272cc44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272cc4b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185742.972153:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821855616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789185742.972246:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185742.972337:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7929b2d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789185742.976707:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821855616 00000100:00100000:0.0:1789185742.976876:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821855616 00000100:00100000:0.0:1789185742.978111:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789185742.978132:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f658050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:14383:x1876096821855616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789185742.978174:0:14380:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789185742.978205:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789185742.978209:0:14380:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789185742.979213:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f658050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:14383:x1876096821855616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1083us (6960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185742.979227:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789185742.980314:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821855616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789185742.980464:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789185742.980477:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272cc44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cc4b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.980490:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c7907354e00/0x532743011272cc44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cc4b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.760684:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185743.760754:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185743.760785:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821855744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185743.760879:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185743.761038:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821855744 00000100:00100000:3.0:1789185743.761049:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821855744 00000100:00100000:3.0:1789185743.761160:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185743.761172:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821855744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185743.761222:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185743.761284:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821855744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185743.761293:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185743.761342:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789185743.761368:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821855744:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789185743.761564:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789185744.785345:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789185745.296943:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789185745.827278:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789185746.835084:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185746.835091:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789185746.835095:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7905456800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789185746.835112:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7905456800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1789185746.835135:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c793fc85500 x1876096821856128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789185746.835201:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58cff117-25e2-45dd-b12f-8a52f6f341b2:3278:1876096821855872:0@lo:400:kworker.0 00000100:00100000:3.0:1789185746.835274:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185746.835319:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821856512:0@lo:400:kworker.0 00000100:00100000:3.0:1789185746.835351:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185746.835376:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185746.835382:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821856000:0@lo:400:kworker.0 00000100:00100000:3.0:1789185746.835436:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185746.835476:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821856256:0@lo:400:kworker.0 00000100:00100000:3.0:1789185746.835499:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185746.835513:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185746.835518:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821856384:0@lo:400:kworker.0 00000100:00100000:3.0:1789185746.835554:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185746.835585:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821855872 00000100:00100000:3.0:1789185746.835593:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821855872 00000100:00100000:3.0:1789185746.835639:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789185746.835647:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f65b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:3278:x1876096821855872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185746.835773:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f65b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:3278:x1876096821855872:12345-0@lo:400:kworker.0 Request processed in 126us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185746.835782:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789185746.835815:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821856512 00000100:00100000:3.0:1789185746.835820:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821856512 00000100:00100000:3.0:1789185746.835855:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821856256 00000100:00100000:3.0:1789185746.835859:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821856256 00000100:00100000:3.0:1789185746.835870:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821856384 00000100:00100000:3.0:1789185746.835872:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821856384 00000100:00100000:3.0:1789185746.835885:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185746.835891:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821856512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185746.835923:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821856512:12345-0@lo:400:kworker.0 Request processed in 33us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185746.835930:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185746.835943:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185746.835949:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821856256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185746.835979:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821856256:12345-0@lo:400:kworker.0 Request processed in 31us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185746.835985:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185746.835996:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185746.836002:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821856384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185746.836026:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821856384:12345-0@lo:400:kworker.0 Request processed in 25us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185746.836039:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789185746.836104:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793fc85c00 x1876096821856384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185746.836117:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821856384:0@lo:400:kworker.0 00010000:00080000:3.0:1789185746.836128:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793fc85180 x1876096821856256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185746.836135:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821856256:0@lo:400:kworker.0 00000100:00100000:3.0:1789185746.836163:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58cff117-25e2-45dd-b12f-8a52f6f341b2:3278:1876096821855872:0@lo:400:kworker.0 00010000:00080000:3.0:1789185746.836173:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793fc87800 x1876096821856512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185746.836181:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821856512:0@lo:400:kworker.0 00000100:00100000:3.0:1789185746.836219:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821856000 00000100:00100000:3.0:1789185746.836223:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821856000 00000100:00100000:3.0:1789185746.836251:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185746.836257:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821856000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185746.836292:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821856000:12345-0@lo:400:kworker.0 Request processed in 35us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185746.836298:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185746.836630:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821856000:0@lo:400:kworker.0 00010000:00010000:3.0:1789185746.836664:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185746.836903:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821856128:0@lo:8:kworker.0 00000100:00100000:1.0:1789185746.836939:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185746.836989:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821856128 00000100:00100000:1.0:1789185746.836993:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821856128 00000100:00100000:1.0:1789185746.841916:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185746.841928:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1876096821856128:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789185746.841963:0:15068:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:1.0:1789185746.841997:0:15068:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x532743011272cc52 00002000:00100000:1.0:1789185746.842012:0:15068:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c7936d86000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789185746.842017:0:15068:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789185746.842019:0:15068:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789185746.842347:0:15068:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789185746.842376:0:15068:0:(import.c:65:import_set_state_nolock()) ffff9c7936d83000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185746.842587:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1876096821856128:12345-0@lo:8:kworker.0 Request processed in 657us (5645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185746.842596:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789185746.843061:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793fc85500 x1876096821856128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789185771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789185746.843079:0:3277:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789185746.843088:0:3277:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789185746.843094:0:3277:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789185746.843096:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9c7905456800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789185746.843117:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789185746.843132:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1876096821856128:0@lo:8:kworker.0 00000004:00080000:1.0:1789185746.843160:0:14410:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789185746.845334:0:14410:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 443884925779ns, next at 0ns, rc = 0 00000100:00080000:0.0:1789185746.846856:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185746.846867:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789185746.857225:0:14411:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789185746.857256:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14411:1876096821856768:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789185746.857333:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185746.857367:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7929b2dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185746.857846:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789185746.857860:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821856640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185746.857887:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185746.857920:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821856640 00000100:00100000:2.0:1789185746.857934:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821856640 00000100:00100000:2.0:1789185746.857993:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185746.858001:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876096821856640:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789185746.858021:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1789185746.858032:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185746.858083:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876096821856640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185746.858089:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185746.858118:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821856768 00000100:00100000:2.0:1789185746.858122:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821856768 00010000:00080000:1.0:1789185746.858125:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c793f25dc00 x1876096821856640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185746.858150:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789185746.858150:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821856640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185746.858162:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14411:x1876096821856768:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789185746.860359:0:15068:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789185746.860370:0:15068:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789185746.860375:0:15068:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1789185746.877102:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.877115:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.877133:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.877139:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.877145:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.877165:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.877176:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.877192:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.877214:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789185746.877228:0:15670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185746.877234:0:15670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.877241:0:15670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fee00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185746.877246:0:15670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.877255:0:15670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.877274:0:15670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.877282:0:15670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.877299:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185746.877301:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185746.877303:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185746.880345:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.880366:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061081a38/0x532743011272cc60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.880385:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.880390:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.880434:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061081a38/0x532743011272cc60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.880450:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061081a38/0x532743011272cc60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.880461:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061081a38/0x532743011272cc60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.880469:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061081a38/0x532743011272cc60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.889299:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185746.889588:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185746.889598:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061081a38/0x532743011272cc60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.889612:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fec00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185746.889618:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061081a38/0x532743011272cc60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.889631:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061081a38/0x532743011272cc60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.889657:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061081a38/0x532743011272cc60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.889665:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061081a38/0x532743011272cc60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.889701:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185746.889703:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185746.889706:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185746.889989:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.889998:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272cc67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.890011:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.890016:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.890023:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272cc67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.890185:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272cc67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.890203:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272cc67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.890211:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272cc67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.890236:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185746.890448:0:15669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185746.890456:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272cc67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.890465:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073ff600 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185746.890470:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272cc67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.890479:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272cc67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.890560:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272cc67 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.890568:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056c0f688/0x532743011272cc67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.890584:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185746.890585:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185746.890587:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185746.890773:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.890780:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e321099/0x532743011272cc6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.890790:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.890793:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.890798:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e321099/0x532743011272cc6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.890808:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e321099/0x532743011272cc6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.890816:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e321099/0x532743011272cc6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.890824:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e321099/0x532743011272cc6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.890852:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185746.891157:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185746.891164:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e321099/0x532743011272cc6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.891184:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073ffc00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185746.891188:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e321099/0x532743011272cc6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.891196:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e321099/0x532743011272cc6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.891210:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e321099/0x532743011272cc6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.891217:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e321099/0x532743011272cc6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.891232:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.891234:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.891235:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185746.892768:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.892780:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006125110b/0x532743011272cc75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.892796:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.892800:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.892806:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006125110b/0x532743011272cc75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.892817:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006125110b/0x532743011272cc75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.892826:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006125110b/0x532743011272cc75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.892834:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006125110b/0x532743011272cc75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.892854:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185746.893009:0:15670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185746.893019:0:15670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006125110b/0x532743011272cc75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.893029:0:15670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fe200 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185746.893032:0:15670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006125110b/0x532743011272cc75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.893042:0:15670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006125110b/0x532743011272cc75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.893065:0:15670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006125110b/0x532743011272cc75 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.893073:0:15670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006125110b/0x532743011272cc75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.893090:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.893092:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.893094:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185746.893914:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.893924:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098eed889/0x532743011272cc7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.893935:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.893945:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.893951:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098eed889/0x532743011272cc7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.893963:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098eed889/0x532743011272cc7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.893972:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098eed889/0x532743011272cc7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.893979:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098eed889/0x532743011272cc7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.893995:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789185746.894932:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.894942:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c324d6e4/0x532743011272cc83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.894953:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.894957:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.894962:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c324d6e4/0x532743011272cc83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.894973:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c324d6e4/0x532743011272cc83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.894983:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c324d6e4/0x532743011272cc83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.894998:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c324d6e4/0x532743011272cc83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.895016:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789185746.897013:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.897026:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000453ff55/0x532743011272cc8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.897384:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.897388:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.897394:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000453ff55/0x532743011272cc8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.897438:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000453ff55/0x532743011272cc8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.897450:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000453ff55/0x532743011272cc8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.897457:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000453ff55/0x532743011272cc8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.897486:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789185746.897708:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789185746.897717:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098eed889/0x532743011272cc7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.897727:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073ff000 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185746.897731:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098eed889/0x532743011272cc7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.897742:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098eed889/0x532743011272cc7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.897760:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098eed889/0x532743011272cc7c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.897768:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098eed889/0x532743011272cc7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.897804:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185746.897808:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c324d6e4/0x532743011272cc83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.897816:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fe600 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185746.897820:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c324d6e4/0x532743011272cc83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.897828:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c324d6e4/0x532743011272cc83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.897838:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c324d6e4/0x532743011272cc83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.897845:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c324d6e4/0x532743011272cc83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.897878:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185746.897882:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000453ff55/0x532743011272cc8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.897888:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073ff200 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185746.897892:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000453ff55/0x532743011272cc8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.897911:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000453ff55/0x532743011272cc8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.897924:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000453ff55/0x532743011272cc8a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.897932:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000453ff55/0x532743011272cc8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.897948:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.897950:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.897952:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185746.900820:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185746.900830:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185746.901538:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.901550:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bd84344/0x532743011272cc91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.901580:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.902703:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.902713:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bd84344/0x532743011272cc91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.902731:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bd84344/0x532743011272cc91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.902744:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bd84344/0x532743011272cc91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.902752:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bd84344/0x532743011272cc91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.902774:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789185746.902788:0:15670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185746.902793:0:15670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bd84344/0x532743011272cc91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.902801:0:15670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073ffe00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185746.902805:0:15670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bd84344/0x532743011272cc91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.902814:0:15670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bd84344/0x532743011272cc91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.902846:0:15670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bd84344/0x532743011272cc91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.902855:0:15670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bd84344/0x532743011272cc91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.902878:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185746.902880:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185746.902882:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789185746.906194:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789185746.907377:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.907390:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.907438:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.907443:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.907449:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.907465:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.907476:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.907485:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.907518:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185746.908203:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185746.908213:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.908225:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fee00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185746.908230:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.908241:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.908259:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.908278:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040506a3/0x532743011272cc98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.908298:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.908300:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.908302:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185746.910950:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.910963:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5ba1c03/0x532743011272cc9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.910980:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.910986:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.910992:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5ba1c03/0x532743011272cc9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.911006:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5ba1c03/0x532743011272cc9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.911017:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5ba1c03/0x532743011272cc9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.911026:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5ba1c03/0x532743011272cc9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.911054:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185746.911123:0:15669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185746.911138:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5ba1c03/0x532743011272cc9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.911148:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fe000 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185746.911154:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5ba1c03/0x532743011272cc9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.911163:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5ba1c03/0x532743011272cc9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.911180:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5ba1c03/0x532743011272cc9f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.911187:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5ba1c03/0x532743011272cc9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.911211:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185746.911215:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185746.911217:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185746.912995:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.913008:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272cca6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.913026:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.913037:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.913044:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272cca6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.913059:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272cca6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.913070:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272cca6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.913078:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272cca6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.913109:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185746.913454:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185746.913462:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272cca6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.913472:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073ff800 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185746.913477:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272cca6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.913487:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272cca6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.913507:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272cca6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.913514:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9ed302e/0x532743011272cca6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.913538:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185746.913540:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185746.913549:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185746.913652:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.913659:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000716ceac9/0x532743011272ccad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.913669:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.913673:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.913678:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000716ceac9/0x532743011272ccad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.913688:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000716ceac9/0x532743011272ccad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.913696:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000716ceac9/0x532743011272ccad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.913711:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000716ceac9/0x532743011272ccad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.913736:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185746.914118:0:15670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185746.914126:0:15670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000716ceac9/0x532743011272ccad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.914135:0:15670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073ff400 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185746.914139:0:15670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000716ceac9/0x532743011272ccad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.914149:0:15670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000716ceac9/0x532743011272ccad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.914164:0:15670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000716ceac9/0x532743011272ccad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.914172:0:15670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000716ceac9/0x532743011272ccad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.914187:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.914189:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.914191:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185746.914197:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.914205:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003739dfa/0x532743011272ccb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.914215:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.914218:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.914222:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003739dfa/0x532743011272ccb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.914232:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003739dfa/0x532743011272ccb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.914240:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003739dfa/0x532743011272ccb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.914247:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003739dfa/0x532743011272ccb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.914277:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185746.914445:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185746.914451:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003739dfa/0x532743011272ccb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.914458:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7400 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185746.914462:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003739dfa/0x532743011272ccb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.914469:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003739dfa/0x532743011272ccb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.914480:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003739dfa/0x532743011272ccb4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.914487:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003739dfa/0x532743011272ccb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.914500:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.914502:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.914503:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185746.920070:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.920082:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bb342b9/0x532743011272ccbb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.920107:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.920113:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.920121:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bb342b9/0x532743011272ccbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.920139:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bb342b9/0x532743011272ccbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.920150:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bb342b9/0x532743011272ccbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.920160:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bb342b9/0x532743011272ccbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.920197:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185746.920285:0:15669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185746.920295:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bb342b9/0x532743011272ccbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.920306:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6400 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185746.920312:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bb342b9/0x532743011272ccbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.920324:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bb342b9/0x532743011272ccbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.920343:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bb342b9/0x532743011272ccbb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.920352:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bb342b9/0x532743011272ccbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.920373:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185746.920376:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185746.920378:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185746.920742:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.920748:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b73027e1/0x532743011272ccc2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.920757:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.920761:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.920765:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b73027e1/0x532743011272ccc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.920776:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b73027e1/0x532743011272ccc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.920796:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b73027e1/0x532743011272ccc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.920803:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b73027e1/0x532743011272ccc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.920828:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185746.921060:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185746.921067:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b73027e1/0x532743011272ccc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.921077:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6800 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185746.921081:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b73027e1/0x532743011272ccc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.921101:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b73027e1/0x532743011272ccc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.921113:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b73027e1/0x532743011272ccc2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.921119:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b73027e1/0x532743011272ccc2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.921133:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185746.921135:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185746.921137:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185746.921297:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.921303:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.921311:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.921314:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.921318:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.921329:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.921337:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.921345:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.921375:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789185746.921387:0:15670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185746.921392:0:15670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.921443:0:15670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7800 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185746.921447:0:15670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.921455:0:15670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.921467:0:15670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccc9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.921474:0:15670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.921494:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185746.921497:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185746.921500:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185746.922007:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.922014:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024e4cad1/0x532743011272ccd0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.922022:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.922031:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.922035:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024e4cad1/0x532743011272ccd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.922046:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024e4cad1/0x532743011272ccd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.922055:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024e4cad1/0x532743011272ccd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.922062:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024e4cad1/0x532743011272ccd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.922086:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185746.922103:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185746.922110:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024e4cad1/0x532743011272ccd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.922119:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7a00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185746.922123:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024e4cad1/0x532743011272ccd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.922143:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024e4cad1/0x532743011272ccd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.922155:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024e4cad1/0x532743011272ccd0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.922162:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024e4cad1/0x532743011272ccd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.922176:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185746.922178:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185746.922180:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185746.927124:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789185746.927140:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccd7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.927160:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789185746.927165:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.927171:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.927187:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.927199:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.927215:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.927242:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185746.927620:0:15669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185746.927628:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.927639:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7800 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185746.927644:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.927654:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.927673:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccd7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.927692:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272ccd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.927711:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185746.927713:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185746.927715:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185746.928854:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185746.928861:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272ccde lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.928871:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789185746.928875:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185746.928879:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272ccde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.928887:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272ccde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.928893:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272ccde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.928898:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272ccde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.928916:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789185746.929257:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185746.929268:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dfd67bf/0x532743011272cce5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.929277:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789185746.929280:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185746.929283:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dfd67bf/0x532743011272cce5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.929292:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008dfd67bf/0x532743011272cce5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.929299:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dfd67bf/0x532743011272cce5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.929306:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008dfd67bf/0x532743011272cce5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.929324:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789185746.929374:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789185746.929382:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272ccde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.929391:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ed000 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185746.929396:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272ccde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.929437:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272ccde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.929464:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272ccde lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.929472:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272ccde lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.929492:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185746.929496:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008dfd67bf/0x532743011272cce5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.929515:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013eda00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185746.929519:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008dfd67bf/0x532743011272cce5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.929528:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008dfd67bf/0x532743011272cce5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.929541:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008dfd67bf/0x532743011272cce5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.929549:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dfd67bf/0x532743011272cce5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.929568:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.929570:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185746.929571:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185746.929576:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185746.929761:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185746.929767:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb47d15e/0x532743011272ccec lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.929776:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789185746.929779:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185746.929782:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb47d15e/0x532743011272ccec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.929792:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb47d15e/0x532743011272ccec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.929806:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb47d15e/0x532743011272ccec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.929813:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb47d15e/0x532743011272ccec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.929839:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789185746.930211:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789185746.930217:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075e5293a/0x532743011272ccf3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.930225:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789185746.930229:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185746.930233:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075e5293a/0x532743011272ccf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.930243:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075e5293a/0x532743011272ccf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.930251:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075e5293a/0x532743011272ccf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.930258:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075e5293a/0x532743011272ccf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.930294:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789185746.930340:0:15669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185746.930347:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb47d15e/0x532743011272ccec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.930355:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ece00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185746.930358:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb47d15e/0x532743011272ccec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.930366:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb47d15e/0x532743011272ccec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.930380:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb47d15e/0x532743011272ccec lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.930656:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb47d15e/0x532743011272ccec lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.930670:0:15669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185746.930673:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075e5293a/0x532743011272ccf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.930680:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013eca00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185746.930683:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075e5293a/0x532743011272ccf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.930689:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075e5293a/0x532743011272ccf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.930699:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075e5293a/0x532743011272ccf3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.930845:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185746.930931:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075e5293a/0x532743011272ccf3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.930944:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185746.930946:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185746.930948:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789185746.933452:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789185746.933465:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272ccfa lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.933487:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789185746.933492:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185746.933499:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272ccfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.933514:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272ccfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.933524:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272ccfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.933532:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272ccfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.933558:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185746.933609:0:15670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185746.933617:0:15670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272ccfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.933624:0:15670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354c00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185746.933629:0:15670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272ccfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.933644:0:15670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272ccfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.933661:0:15670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272ccfa lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.933669:0:15670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272ccfa lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.933686:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.933688:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.933690:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789185746.934936:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789185746.934946:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272cd01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.934959:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789185746.934963:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185746.934969:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272cd01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.934981:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272cd01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.935259:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272cd01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.935266:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272cd01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.935286:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789185746.935375:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185746.935384:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272cd01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.935394:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354000 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:2.0:1789185746.935441:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272cd01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.935453:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272cd01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.935480:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272cd01 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.935488:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c012fc74/0x532743011272cd01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.935510:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185746.935513:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185746.935515:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789185746.936216:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789185746.936225:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272cd08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.936235:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789185746.936238:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185746.936244:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272cd08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.936255:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272cd08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.936264:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272cd08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.936271:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272cd08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.936304:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789185746.937549:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789185746.937559:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272cd0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.937572:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789185746.937576:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185746.937581:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272cd0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.937592:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272cd0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.937602:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272cd0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.937610:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272cd0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.937630:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789185746.937642:0:15669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789185746.937650:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272cd08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.937658:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355a00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185746.937663:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272cd08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.937672:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272cd08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.937688:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272cd08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.937696:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014050d59/0x532743011272cd08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.937713:0:15669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185746.937717:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272cd0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.937723:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355c00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185746.937726:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272cd0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.937745:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272cd0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.937756:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272cd0f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.937764:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272cd0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.937774:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185746.937776:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185746.937778:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789185746.938275:0:15068:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1789185746.938386:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14411:x1876096821856768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 80223us (81050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185746.938396:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789185746.938467:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14411:1876096821856768:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789185746.938485:0:14411:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789185746.938532:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14411:1876096821856896:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789185746.938566:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185746.938615:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79107159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185746.938623:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821856896 00000100:00100000:0.0:1789185746.938635:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821856896 00000100:00100000:0.0:1789185746.938683:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789185746.938692:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14411:x1876096821856896:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789185746.938727:0:15069:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1789185746.940247:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185746.950396:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14411:x1876096821856896:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11700us (11824us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789185746.950436:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789185746.950496:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14411:1876096821856896:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789185746.950516:0:14411:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1789185747.856213:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185748.880554:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185748.890756:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821857024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185748.890825:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185748.890903:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821857024 00000100:00100000:0.0:1789185748.890911:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821857024 00000100:00100000:0.0:1789185748.890973:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789185748.890983:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821857024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789185748.891018:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789185748.891066:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821857024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185748.891073:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789185748.891122:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821857024:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789185748.895595:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1789185749.019837:0:16146:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789185749.905115:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185750.929265:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185751.684350:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185751.684562:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812424960 00000100:00100000:3.0:1789185751.684573:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812424960 00000100:00100000:3.0:1789185751.684621:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:3.0:1789185751.684929:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f659450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2368:x1876096812424960:12345-192.168.202.54@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789185751.684955:0:14380:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 3bf990f1-01b6-4798-9f3a-975e9044ba2c@192.168.202.54@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:3.0:1789185751.684994:0:14380:0:(genops.c:1384:class_connect()) connect: client 3bf990f1-01b6-4798-9f3a-975e9044ba2c, cookie 0x532743011272cd16 00000100:00080000:3.0:1789185751.685557:0:14380:0:(import.c:65:import_set_state_nolock()) ffff9c7904f00000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185751.686157:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f659450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+5:2368:x1876096812424960:12345-192.168.202.54@tcp:250:mount.lustre.0 Request processed in 699us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185751.686166:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:3.0:1789185751.690774:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185751.691000:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812425088 00000100:00100000:2.0:1789185751.691012:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812425088 00000100:00100000:2.0:1789185751.691073:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:2.0:1789185751.691083:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f65bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+5:13772:x1876096812425088:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789185751.691100:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185751.691117:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d6200/0x532743011272cd1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d877 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.691153:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d6200/0x532743011272cd1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d877 expref: 6 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.691164:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d6200/0x532743011272cd1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d877 expref: 6 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.691190:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6200, rc 0) 00000100:00100000:2.0:1789185751.691245:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f65bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+6:13772:x1876096812425088:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 163us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185751.691252:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:1.0:1789185751.697810:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185751.697899:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812425216 00000100:00100000:3.0:1789185751.697910:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812425216 00000100:00100000:3.0:1789185751.697965:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:3.0:1789185751.697976:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+6:13772:x1876096812425216:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789185751.698266:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+6:13772:x1876096812425216:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 290us (465us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789185751.698276:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:0.0:1789185751.701638:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185751.701746:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812425344 00000100:00100000:2.0:1789185751.701757:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812425344 00000100:00100000:2.0:1789185751.701816:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:2.0:1789185751.701827:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f65a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+6:13772:x1876096812425344:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789185751.701844:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185751.701863:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d7600/0x532743011272cd24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d87e expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.701893:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d7600/0x532743011272cd24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d87e expref: 7 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.701904:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d7600/0x532743011272cd24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d87e expref: 7 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.701913:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7600, rc 0) 00000100:00100000:2.0:1789185751.701973:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f65a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+7:13772:x1876096812425344:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 147us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185751.701980:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:0.0:1789185751.716269:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185751.721590:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812425472 00000100:00100000:1.0:1789185751.721607:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812425472 00000100:00100000:1.0:1789185751.721679:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:1.0:1789185751.721690:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f65ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+7:13772:x1876096812425472:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789185751.724577:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f65ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+8:13772:x1876096812425472:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 2878us (8307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185751.724593:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:1.0:1789185751.734203:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185751.734431:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812425600 00000100:00100000:3.0:1789185751.734442:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812425600 00000100:00100000:3.0:1789185751.734502:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:3.0:1789185751.734514:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f65a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+8:13772:x1876096812425600:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789185751.735208:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f65a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+8:13772:x1876096812425600:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 694us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185751.735219:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:0.0:1789185751.740981:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185751.741092:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812425728 00000100:00100000:1.0:1789185751.741103:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812425728 00000100:00100000:1.0:1789185751.741162:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:1.0:1789185751.741173:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+8:13790:x1876096812425728:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789185751.741437:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+8:13790:x1876096812425728:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 265us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185751.741446:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:0.0:1789185751.751634:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185751.751728:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812425856 00000100:00100000:3.0:1789185751.751739:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812425856 00000100:00100000:3.0:1789185751.751808:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:3.0:1789185751.751819:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f659050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+8:13790:x1876096812425856:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789185751.752454:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f659050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+8:13790:x1876096812425856:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 587us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185751.752464:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:2.0:1789185751.765205:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185751.765485:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812425984 00000100:00100000:3.0:1789185751.765496:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812425984 00000100:00100000:3.0:1789185751.765609:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:3.0:1789185751.765621:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f65a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+8:13772:x1876096812425984:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789185751.765651:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185751.765668:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe05800/0x532743011272cd2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d8a8 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185751.765695:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe05800/0x532743011272cd2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8a8 expref: 9 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185751.765706:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe05800/0x532743011272cd2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8a8 expref: 9 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185751.765715:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05800, rc 0) 00000100:00100000:3.0:1789185751.765793:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f65a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+9:13772:x1876096812425984:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 174us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185751.765800:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:0.0:1789185751.778853:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185751.778996:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812426112 00000100:00100000:3.0:1789185751.779007:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812426112 00000100:00100000:3.0:1789185751.779063:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:3.0:1789185751.779074:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+9:13772:x1876096812426112:12345-192.168.202.54@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789185751.779101:0:14380:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789185751.779126:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789185751.779130:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789185751.779133:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789185751.779136:0:14380:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789185751.781515:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+9:13772:x1876096812426112:12345-192.168.202.54@tcp:256:mount.lustre.0 Request processed in 2433us (2735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185751.781530:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:2.0:1789185751.792059:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185751.792132:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812426240 00000100:00100000:3.0:1789185751.792155:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812426240 00000100:00100000:3.0:1789185751.792217:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:3.0:1789185751.792227:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+9:13772:x1876096812426240:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789185751.792245:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185751.792262:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe04e00/0x532743011272cd32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d8af expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185751.792290:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe04e00/0x532743011272cd32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8af expref: 10 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185751.792303:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe04e00/0x532743011272cd32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8af expref: 10 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185751.792312:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04e00, rc 0) 00000100:00100000:3.0:1789185751.792386:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+10:13772:x1876096812426240:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 160us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185751.792393:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:0.0:1789185751.798062:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185751.798192:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812426368 00000100:00100000:3.0:1789185751.798203:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812426368 00000100:00100000:3.0:1789185751.798270:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:3.0:1789185751.798281:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+10:13772:x1876096812426368:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789185751.798618:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+10:13772:x1876096812426368:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 338us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185751.798627:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:0.0:1789185751.802631:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185751.802798:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812426496 00000100:00100000:1.0:1789185751.802809:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812426496 00000100:00100000:1.0:1789185751.802874:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:1.0:1789185751.802885:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+10:13772:x1876096812426496:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789185751.803127:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+10:13772:x1876096812426496:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 243us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185751.803136:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:1.0:1789185751.807231:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185751.808464:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812426624 00000100:00100000:2.0:1789185751.808477:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812426624 00000100:00100000:2.0:1789185751.808554:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:2.0:1789185751.808565:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+10:13794:x1876096812426624:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789185751.808837:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+10:13794:x1876096812426624:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 273us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185751.808845:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:0.0:1789185751.824656:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185751.824815:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812426752 00000100:00100000:3.0:1789185751.824825:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812426752 00000100:00100000:3.0:1789185751.824880:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00100000:3.0:1789185751.824891:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+10:13794:x1876096812426752:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789185751.825165:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+10:13794:x1876096812426752:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 275us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185751.825173:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00100000:0.0:1789185751.838552:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185751.839117:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812426880 00000100:00100000:3.0:1789185751.839128:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812426880 00000100:00100000:3.0:1789185751.839184:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:3.0:1789185751.839192:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2368:x1876096812426880:12345-192.168.202.54@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789185751.839222:0:14387:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c595249a-629e-4223-b27d-e43e596c040e@192.168.202.54@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:3.0:1789185751.839270:0:14387:0:(genops.c:1384:class_connect()) connect: client c595249a-629e-4223-b27d-e43e596c040e, cookie 0x532743011272cd39 00000004:00100000:3.0:1789185751.839300:0:14387:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:3.0:1789185751.839306:0:14387:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789185751.931460:0:14387:0:(import.c:65:import_set_state_nolock()) ffff9c79037ab800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185751.931583:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+6:2368:x1876096812426880:12345-192.168.202.54@tcp:38:mount.lustre.0 Request processed in 92388us (93040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185751.931595:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:0.0:1789185751.935127:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185751.935402:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812427008 00000100:00100000:3.0:1789185751.935446:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812427008 00000100:00100000:3.0:1789185751.935512:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:3.0:1789185751.935524:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+6:0:x1876096812427008:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789185751.935568:0:14386:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789185751.935668:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+6:0:x1876096812427008:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 146us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185751.935675:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00080000:0.0:1789185751.935750:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185751.936795:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185751.936848:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812427136 00000100:00100000:1.0:1789185751.936856:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812427136 00000100:00100000:1.0:1789185751.936918:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:1.0:1789185751.936927:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+6:13772:x1876096812427136:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789185751.936952:0:15092:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789185751.937031:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+6:13772:x1876096812427136:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 98us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185751.937039:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:1.0:1789185751.938957:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185751.939099:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812427264 00000100:00100000:2.0:1789185751.939108:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812427264 00000100:00100000:2.0:1789185751.939196:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:2.0:1789185751.939207:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+6:13772:x1876096812427264:12345-192.168.202.54@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789185751.939301:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+6:13772:x1876096812427264:12345-192.168.202.54@tcp:40:mount.lustre.0 Request processed in 94us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185751.939308:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1789185751.943953:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185751.944028:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185751.944325:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812427392 00000100:00100000:1.0:1789185751.944337:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812427392 00000100:00100000:1.0:1789185751.944390:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812427520 00000100:00100000:1.0:1789185751.944393:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812427520 00000100:00100000:1.0:1789185751.944440:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:1.0:1789185751.944448:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2368:x1876096812427392:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789185751.944484:0:15068:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c595249a-629e-4223-b27d-e43e596c040e@192.168.202.54@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:1.0:1789185751.944539:0:15068:0:(genops.c:1384:class_connect()) connect: client c595249a-629e-4223-b27d-e43e596c040e, cookie 0x532743011272cd40 00002000:00100000:1.0:1789185751.944552:0:15068:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c595249a-629e-4223-b27d-e43e596c040e/ffff9c793a522000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789185751.944578:0:15068:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789185751.944940:0:15068:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789185751.944971:0:15068:0:(import.c:65:import_set_state_nolock()) ffff9c793a522800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185751.945049:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c595249a-629e-4223-b27d-e43e596c040e+6:2368:x1876096812427392:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 599us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185751.945058:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:1.0:1789185751.945079:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1789185751.945083:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2368:x1876096812427520:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789185751.945100:0:15068:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c595249a-629e-4223-b27d-e43e596c040e@192.168.202.54@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:1.0:1789185751.945124:0:15068:0:(genops.c:1384:class_connect()) connect: client c595249a-629e-4223-b27d-e43e596c040e, cookie 0x532743011272cd47 00002000:00100000:1.0:1789185751.945130:0:15068:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c595249a-629e-4223-b27d-e43e596c040e/ffff9c793a527800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789185751.945145:0:15068:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789185751.945262:0:15068:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789185751.945280:0:15068:0:(import.c:65:import_set_state_nolock()) ffff9c793a526800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185751.945305:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c595249a-629e-4223-b27d-e43e596c040e+6:2368:x1876096812427520:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 220us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185751.945312:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:0.0:1789185751.946261:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185751.946437:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812427648 00000100:00100000:3.0:1789185751.946444:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812427648 00000100:00100000:3.0:1789185751.946513:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:3.0:1789185751.946522:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c595249a-629e-4223-b27d-e43e596c040e+6:13772:x1876096812427648:12345-192.168.202.54@tcp:33:mount.lustre.0 00000004:00080000:0.0:1789185751.950927:0:14389:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4345us 00000100:00100000:1.0:1789185751.951739:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821857152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185751.951823:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185751.953146:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821857152 00000100:00100000:2.0:1789185751.953155:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821857152 00000100:00100000:0.0:1789185751.953225:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821857408:0@lo:400:kworker.0 00000100:00100000:0.0:1789185751.953278:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185751.953324:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789185751.953332:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58cff117-25e2-45dd-b12f-8a52f6f341b2:3279:1876096821857280:0@lo:400:kworker.0 00000100:00100000:0.0:1789185751.953369:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185751.953392:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1876096821857792:0@lo:400:kworker.0 00000100:00100000:0.0:1789185751.953437:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185751.953463:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821857536:0@lo:400:kworker.0 00000100:00100000:0.0:1789185751.953486:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185751.953503:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185751.953508:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821857664:0@lo:400:kworker.0 00000100:00100000:0.0:1789185751.953526:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185751.953565:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821857280 00000100:00100000:0.0:1789185751.953570:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821857280 00000100:00100000:0.0:1789185751.953609:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789185751.953618:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:3279:x1876096821857280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185751.953668:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:3279:x1876096821857280:12345-0@lo:400:kworker.0 Request processed in 51us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185751.953675:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789185751.953720:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821857792 00000100:00100000:0.0:1789185751.953724:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821857792 00000100:00100000:0.0:1789185751.953757:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821857536 00000100:00100000:0.0:1789185751.954151:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821857536 00000100:00100000:0.0:1789185751.954172:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821857664 00000100:00100000:0.0:1789185751.954174:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821857664 00000100:00100000:0.0:1789185751.954187:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789185751.954194:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876096821857792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185751.954230:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876096821857792:12345-0@lo:400:kworker.0 Request processed in 37us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185751.954236:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789185751.954247:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789185751.954252:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821857536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185751.954282:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876096821857536:12345-0@lo:400:kworker.0 Request processed in 30us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185751.954287:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789185751.954298:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789185751.954304:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821857664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185751.954338:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876096821857664:12345-0@lo:400:kworker.0 Request processed in 35us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185751.954344:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789185751.954651:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58cff117-25e2-45dd-b12f-8a52f6f341b2:3279:1876096821857280:0@lo:400:kworker.0 00010000:00080000:0.0:1789185751.954667:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c792ff5e680 x1876096821857792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185751.954679:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1876096821857792:0@lo:400:kworker.0 00010000:00080000:0.0:1789185751.954706:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c792ff5c380 x1876096821857664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185751.954722:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1876096821857664:0@lo:400:kworker.0 00010000:00080000:0.0:1789185751.954734:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c792ff5fb80 x1876096821857536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185751.954743:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876096821857536:0@lo:400:kworker.0 00000100:00080000:0.0:1789185751.954827:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185751.954846:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821857408 00000100:00100000:0.0:1789185751.954851:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821857408 00000100:00100000:0.0:1789185751.954884:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789185751.954891:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821857408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185751.954932:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821857408:12345-0@lo:400:kworker.0 Request processed in 42us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185751.954937:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789185751.954963:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821857408:0@lo:400:kworker.0 00000100:00080000:0.0:1789185751.954978:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789185751.961318:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185751.964943:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789185751.964958:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1876096821857152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789185751.964985:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185751.965086:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1876096821857152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (13262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185751.965093:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789185751.965151:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821857152:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789185751.978265:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00200000:3.0:1789185752.010037:0:14389:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789185752.010169:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c595249a-629e-4223-b27d-e43e596c040e+6:13772:x1876096812427648:12345-192.168.202.54@tcp:33:mount.lustre.0 Request processed in 63641us (63904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185752.010181:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000001:00100000:3.0:1789185752.069839:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c595249a-629e-4223-b27d-e43e596c040e 00000001:00080000:1.0:1789185752.104600:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789185752.104625:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c595249a-629e-4223-b27d-e43e596c040e 00000001:00100000:1.0:1789185752.104637:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789185752.271534:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185752.275736:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812427776 00000100:00100000:3.0:1789185752.275754:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812427776 00000100:00100000:3.0:1789185752.275847:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:3.0:1789185752.275859:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+6:13816:x1876096812427776:12345-192.168.202.54@tcp:101:mkdir.0 00010000:00010000:3.0:1789185752.275882:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185752.275912:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272cd4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d8d9 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185752.275995:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272cd55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185752.276336:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272cd55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185752.276364:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272cd55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185752.276401:0:14387:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789185752.276422:0:14387:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789185752.276459:0:14387:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272cd55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185752.276485:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05a00/0x532743011272cd4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8d9 expref: 8 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185752.276504:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272cd55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8d9 expref: 7 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185752.276526:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:3.0:1789185752.276529:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789185752.276533:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05400, rc 0) 00000100:00100000:3.0:1789185752.276603:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+7:13816:x1876096812427776:12345-192.168.202.54@tcp:101:mkdir.0 Request processed in 747us (5079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185752.276611:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00010000:00010000:2.0:1789185752.975782:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185753.999695:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185753.999721:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821857920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185753.999808:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185754.000322:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821857920 00000100:00100000:0.0:1789185754.000340:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821857920 00000100:00100000:0.0:1789185754.000432:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185754.000442:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821857920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789185754.000479:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789185754.000532:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821857920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.000539:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185754.000589:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821857920:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789185754.000822:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789185754.001439:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185754.439934:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185754.440144:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812427904 00000100:00100000:0.0:1789185754.440156:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812427904 00000100:00100000:0.0:1789185754.440246:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:0.0:1789185754.440259:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+7:13868:x1876096812427904:12345-192.168.202.54@tcp:41:lfs.0 00000004:00000024:0.0:1789185754.440303:0:15092:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789185754.440441:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+7:13868:x1876096812427904:12345-192.168.202.54@tcp:41:lfs.0 Request processed in 150us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.440448:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00080000:3.0:1789185754.441060:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185754.445796:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185754.445917:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812428032 00000100:00100000:2.0:1789185754.445928:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812428032 00000100:00100000:2.0:1789185754.446001:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00080000:3.0:1789185754.446010:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185754.446018:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c595249a-629e-4223-b27d-e43e596c040e+5:13868:x1876096812428032:12345-192.168.202.54@tcp:13:lfs.0 00002000:00000024:2.0:1789185754.446057:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185754.446136:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c595249a-629e-4223-b27d-e43e596c040e+5:13868:x1876096812428032:12345-192.168.202.54@tcp:13:lfs.0 Request processed in 125us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185754.446144:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:1.0:1789185754.449744:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185754.452825:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812428160 00000100:00100000:2.0:1789185754.452851:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812428160 00000100:00100000:2.0:1789185754.452945:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:2.0:1789185754.452957:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c595249a-629e-4223-b27d-e43e596c040e+5:13868:x1876096812428160:12345-192.168.202.54@tcp:13:lfs.0 00002000:00000024:2.0:1789185754.453000:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185754.453088:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c595249a-629e-4223-b27d-e43e596c040e+5:13868:x1876096812428160:12345-192.168.202.54@tcp:13:lfs.0 Request processed in 135us (3355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185754.453096:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00080000:0.0:1789185754.453722:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185754.612514:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185754.612652:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812428288 00000100:00100000:2.0:1789185754.612667:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812428288 00000100:00100000:2.0:1789185754.612744:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:2.0:1789185754.612755:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+10:13899:x1876096812428288:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789185754.612779:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185754.612803:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d7000/0x532743011272cd5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d8e0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185754.612839:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d7000/0x532743011272cd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8e0 expref: 11 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185754.612850:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d7000/0x532743011272cd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8e0 expref: 11 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185754.612859:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7000, rc 0) 00000100:00100000:2.0:1789185754.612969:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+11:13899:x1876096812428288:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 206us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185754.612978:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:2.0:1789185754.626359:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185754.626508:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812428416 00000100:00100000:0.0:1789185754.626522:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812428416 00000100:00100000:0.0:1789185754.626597:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00100000:0.0:1789185754.626611:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7918bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+11:13899:x1876096812428416:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789185754.627121:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7918bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+11:13899:x1876096812428416:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 511us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.627131:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00100000:1.0:1789185754.629703:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185754.630889:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812428544 00000100:00100000:0.0:1789185754.630907:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812428544 00000100:00100000:0.0:1789185754.631129:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:0.0:1789185754.631144:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+11:13899:x1876096812428544:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789185754.632032:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+11:13899:x1876096812428544:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 885us (2336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.632044:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:3.0:1789185754.640820:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185754.645193:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812428672 00000100:00100000:2.0:1789185754.645214:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812428672 00000100:00100000:2.0:1789185754.645381:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:2.0:1789185754.645395:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+11:13906:x1876096812428672:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789185754.646076:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+11:13906:x1876096812428672:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 681us (5269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185754.646088:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:2.0:1789185754.677778:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185754.678171:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812428800 00000100:00100000:0.0:1789185754.678205:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812428800 00000100:00100000:0.0:1789185754.678322:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:0.0:1789185754.678346:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+11:13906:x1876096812428800:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789185754.678762:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+11:13906:x1876096812428800:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 418us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.678772:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:1.0:1789185754.683492:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185754.683708:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812428928 00000100:00100000:0.0:1789185754.683728:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812428928 00000100:00100000:0.0:1789185754.687389:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 96 00000100:00100000:0.0:1789185754.687438:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+11:13899:x1876096812428928:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789185754.687466:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185754.687495:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7907354200/0x532743011272cd63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d90a expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185754.687537:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7907354200/0x532743011272cd63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d90a expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185754.687550:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7907354200/0x532743011272cd63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d90a expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185754.687562:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354200, rc 0) 00000100:00100000:0.0:1789185754.687657:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+12:13899:x1876096812428928:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 251us (4179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.687665:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 96 00000100:00100000:1.0:1789185754.689457:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185754.689556:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812429056 00000100:00100000:2.0:1789185754.689583:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812429056 00000100:00100000:2.0:1789185754.689766:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:2.0:1789185754.689775:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+12:13899:x1876096812429056:12345-192.168.202.54@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789185754.689799:0:14381:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789185754.689828:0:14381:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789185754.689831:0:14381:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789185754.689833:0:14381:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789185754.689835:0:14381:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789185754.691745:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+12:13899:x1876096812429056:12345-192.168.202.54@tcp:256:mount.lustre.0 Request processed in 1960us (2289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.691758:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:1.0:1789185754.694020:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185754.694103:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812429184 00000100:00100000:0.0:1789185754.694113:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812429184 00000100:00100000:0.0:1789185754.694163:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:0.0:1789185754.694171:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+12:13899:x1876096812429184:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789185754.694189:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185754.694210:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7907354a00/0x532743011272cd6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d911 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185754.694240:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7907354a00/0x532743011272cd6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d911 expref: 13 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185754.694250:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7907354a00/0x532743011272cd6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d911 expref: 13 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185754.694257:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354a00, rc 0) 00000100:00100000:0.0:1789185754.694312:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:13899:x1876096812429184:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 142us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.694317:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:1.0:1789185754.695770:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185754.695836:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812429312 00000100:00100000:0.0:1789185754.695844:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812429312 00000100:00100000:0.0:1789185754.695901:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:0.0:1789185754.695912:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:13899:x1876096812429312:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789185754.696249:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:13899:x1876096812429312:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 339us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.696262:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:2.0:1789185754.699108:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185754.699196:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812429440 00000100:00100000:0.0:1789185754.699210:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812429440 00000100:00100000:0.0:1789185754.699306:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00100000:0.0:1789185754.699696:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:13899:x1876096812429440:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789185754.700532:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:13899:x1876096812429440:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 1209us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.700546:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00100000:1.0:1789185754.709091:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185754.709229:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812429568 00000100:00100000:0.0:1789185754.709243:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812429568 00000100:00100000:0.0:1789185754.709315:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:0.0:1789185754.709344:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:13913:x1876096812429568:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789185754.709820:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:13913:x1876096812429568:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 492us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.709830:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:1.0:1789185754.713374:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185754.713455:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812429696 00000100:00100000:0.0:1789185754.713471:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812429696 00000100:00100000:0.0:1789185754.713546:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:0.0:1789185754.713555:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:13913:x1876096812429696:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789185754.713909:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:13913:x1876096812429696:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 352us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.713919:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:2.0:1789185754.729239:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185754.729346:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812429824 00000100:00100000:0.0:1789185754.729361:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812429824 00000100:00100000:3.0:1789185754.729458:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:3.0:1789185754.729472:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2368:x1876096812429824:12345-192.168.202.54@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789185754.729514:0:14387:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 547a6333-e8a7-4d22-b9c1-94adbcd52c7a@192.168.202.54@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:3.0:1789185754.729568:0:14387:0:(genops.c:1384:class_connect()) connect: client 547a6333-e8a7-4d22-b9c1-94adbcd52c7a, cookie 0x532743011272cd71 00000004:00100000:3.0:1789185754.729610:0:14387:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1789185754.729770:0:14387:0:(import.c:65:import_set_state_nolock()) ffff9c7937609800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185754.730357:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:2368:x1876096812429824:12345-192.168.202.54@tcp:38:mount.lustre.0 Request processed in 885us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185754.730367:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789185754.743444:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185754.743492:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185754.743690:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812430080 00000100:00100000:0.0:1789185754.743694:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812429952 00000100:00100000:0.0:1789185754.743704:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812429952 00000100:00100000:2.0:1789185754.743705:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812430080 00000100:00100000:0.0:1789185754.743791:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:2.0:1789185754.743801:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:0.0:1789185754.743807:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+7:0:x1876096812429952:12345-192.168.202.54@tcp:41:mount.lustre.0 00000100:00100000:2.0:1789185754.743816:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+7:13899:x1876096812430080:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789185754.743877:0:15092:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:2.0:1789185754.743878:0:14388:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1789185754.743990:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185754.744182:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+7:0:x1876096812429952:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 380us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.744190:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:2.0:1789185754.747750:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:13899:x1876096812430080:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 3918us (4345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185754.747773:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:1.0:1789185754.751157:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185754.751310:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812430208 00000100:00100000:0.0:1789185754.751323:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812430208 00000100:00100000:0.0:1789185754.751561:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:0.0:1789185754.751574:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:13899:x1876096812430208:12345-192.168.202.54@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789185754.751689:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:13899:x1876096812430208:12345-192.168.202.54@tcp:40:mount.lustre.0 Request processed in 118us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.751698:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1789185754.754646:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185754.754867:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812430592 00000100:00100000:0.0:1789185754.754877:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812430592 00000100:00100000:0.0:1789185754.754933:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:0.0:1789185754.754943:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:13899:x1876096812430592:12345-192.168.202.54@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789185754.755047:0:14390:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789185754.755139:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:13899:x1876096812430592:12345-192.168.202.54@tcp:33:mount.lustre.0 Request processed in 197us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.755147:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:3.0:1789185754.755468:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185754.755564:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812430336 00000100:00100000:1.0:1789185754.755684:0:15070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812430336 00000100:00100000:1.0:1789185754.755720:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789185754.755728:0:15070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2368:x1876096812430336:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789185754.755761:0:15070:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 547a6333-e8a7-4d22-b9c1-94adbcd52c7a@192.168.202.54@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:1.0:1789185754.755804:0:15070:0:(genops.c:1384:class_connect()) connect: client 547a6333-e8a7-4d22-b9c1-94adbcd52c7a, cookie 0x532743011272cd78 00002000:00100000:1.0:1789185754.755820:0:15070:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 547a6333-e8a7-4d22-b9c1-94adbcd52c7a/ffff9c793a520800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789185754.755835:0:15070:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:3.0:1789185754.757712:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185754.757828:0:15069:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789185754.757851:0:15069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:1.0:1789185754.758455:0:15070:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789185754.758505:0:15070:0:(import.c:65:import_set_state_nolock()) ffff9c793a523800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185754.758710:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812430464 00000100:00100000:3.0:1789185754.758718:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812430464 00000100:00100000:2.0:1789185754.758900:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:2.0:1789185754.758911:0:16267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2368:x1876096812430464:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789185754.758946:0:16267:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 547a6333-e8a7-4d22-b9c1-94adbcd52c7a@192.168.202.54@tcp t0 exp 0000000000000000 cur 451 last 0 00000100:00100000:1.0:1789185754.758962:0:15070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:2368:x1876096812430336:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 3232us (3493us total) trans 0 rc 0/0 00000020:00000080:2.0:1789185754.758980:0:16267:0:(genops.c:1384:class_connect()) connect: client 547a6333-e8a7-4d22-b9c1-94adbcd52c7a, cookie 0x532743011272cd7f 00002000:00100000:2.0:1789185754.758997:0:16267:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 547a6333-e8a7-4d22-b9c1-94adbcd52c7a/ffff9c78028d0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789185754.759010:0:16267:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1789185754.759236:0:16267:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789185754.759260:0:16267:0:(import.c:65:import_set_state_nolock()) ffff9c78028d4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789185754.759304:0:16267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:2368:x1876096812430464:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 393us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185754.760200:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:2.0:1789185754.760210:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:3.0:1789185754.977792:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185754.985276:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812430720 00000100:00100000:0.0:1789185754.985301:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812430720 00000100:00100000:0.0:1789185754.985438:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:0.0:1789185754.985452:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:13934:x1876096812430720:12345-192.168.202.54@tcp:101:mkdir.0 00010000:00010000:0.0:1789185754.985480:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185754.985516:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cd86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d93b expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185754.985637:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272cd8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185754.985655:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272cd8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185754.985673:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272cd8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185754.985722:0:14387:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789185754.985726:0:14387:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185754.985751:0:14387:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272cd8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185754.985784:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cd86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d93b expref: 8 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185754.985807:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272cd8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d93b expref: 7 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185754.985816:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:0.0:1789185754.985819:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185754.985825:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355a00, rc 0) 00000100:00100000:0.0:1789185754.985920:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+7:13934:x1876096812430720:12345-192.168.202.54@tcp:101:mkdir.0 Request processed in 471us (8142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185754.985928:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00010000:00010000:0.0:1789185755.023676:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789185755.536720:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789185756.048544:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185757.071874:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821858048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185757.071986:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185757.075315:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821858048 00000100:00100000:2.0:1789185757.075331:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821858048 00000100:00100000:2.0:1789185757.075428:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789185757.075439:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821858048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789185757.075477:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789185757.075560:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821858048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (3574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185757.075567:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789185757.075630:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789185757.075652:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821858048:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789185757.075808:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185757.079475:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821858304:0@lo:400:kworker.0 00000100:00100000:3.0:1789185757.079542:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185757.079585:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185757.079590:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821858432:0@lo:400:kworker.0 00000100:00100000:3.0:1789185757.079611:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185757.079640:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821858304 00000100:00100000:3.0:1789185757.079647:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821858304 00000100:00100000:3.0:1789185757.079697:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185757.079704:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821858304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185757.079747:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821858304:12345-0@lo:400:kworker.0 Request processed in 43us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185757.079755:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185757.079774:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821858432 00000100:00100000:3.0:1789185757.079778:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821858432 00000100:00100000:3.0:1789185757.079798:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789185757.079803:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821858432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185757.079830:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876096821858432:12345-0@lo:400:kworker.0 Request processed in 27us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185757.079836:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789185757.079865:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876096821858432:0@lo:400:kworker.0 00000100:00100000:3.0:1789185757.079873:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821858304:0@lo:400:kworker.0 00000100:00100000:3.0:1789185757.079905:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58cff117-25e2-45dd-b12f-8a52f6f341b2:3281:1876096821858176:0@lo:400:kworker.0 00000100:00100000:3.0:1789185757.079931:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185757.079953:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821858688:0@lo:400:kworker.0 00000100:00100000:3.0:1789185757.079973:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185757.079990:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185757.079995:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821858560:0@lo:400:kworker.0 00000100:00100000:3.0:1789185757.080013:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185757.080035:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821858176 00000100:00100000:3.0:1789185757.080039:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821858176 00000100:00100000:3.0:1789185757.080062:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789185757.080068:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:3281:x1876096821858176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185757.080102:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:3281:x1876096821858176:12345-0@lo:400:kworker.0 Request processed in 34us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185757.080108:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789185757.080129:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821858688 00000100:00100000:3.0:1789185757.080133:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821858688 00000100:00100000:3.0:1789185757.080152:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821858560 00000100:00100000:3.0:1789185757.080155:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821858560 00000100:00100000:3.0:1789185757.080171:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789185757.080177:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821858688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185757.080208:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821858688:12345-0@lo:400:kworker.0 Request processed in 30us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185757.080214:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789185757.080224:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789185757.080230:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821858560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185757.080254:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821858560:12345-0@lo:400:kworker.0 Request processed in 25us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185757.080265:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789185757.080296:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821858560:0@lo:400:kworker.0 00000100:00100000:3.0:1789185757.080316:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58cff117-25e2-45dd-b12f-8a52f6f341b2:3281:1876096821858176:0@lo:400:kworker.0 00000100:00100000:3.0:1789185757.080326:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821858688:0@lo:400:kworker.0 00000100:00080000:3.0:1789185757.080341:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185757.080345:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789185757.080385:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789185757.137090:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c595249a-629e-4223-b27d-e43e596c040e 00000001:00100000:1.0:1789185757.137108:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 547a6333-e8a7-4d22-b9c1-94adbcd52c7a 00000001:00100000:3.0:1789185757.171821:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 547a6333-e8a7-4d22-b9c1-94adbcd52c7a 00000001:00100000:1.0:1789185757.178609:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 547a6333-e8a7-4d22-b9c1-94adbcd52c7a 00010000:00010000:1.0:1789185758.096673:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789185758.605246:0:16355:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789185759.119750:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185759.119781:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821858816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185759.119880:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185759.120017:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821858816 00000100:00100000:0.0:1789185759.120040:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821858816 00000100:00100000:0.0:1789185759.120127:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789185759.120140:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821858816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789185759.120188:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789185759.120255:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821858816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185759.120262:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789185759.120549:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821858816:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789185759.120895:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789185759.120975:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185759.886141:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185759.886196:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185759.886217:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185759.886254:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185759.886290:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185759.886311:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185759.886338:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185759.886371:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812430848 00000100:00100000:3.0:1789185759.886383:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812430848 00000100:00100000:3.0:1789185759.886484:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:1.0:1789185759.886802:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812430976 00000100:00100000:1.0:1789185759.886808:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812430976 00000100:00100000:1.0:1789185759.886868:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812431360 00000100:00100000:1.0:1789185759.886872:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812431360 00000100:00100000:1.0:1789185759.886899:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:1.0:1789185759.886906:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+6:2371:x1876096812430976:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185759.887016:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+6:2371:x1876096812430976:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 110us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185759.887037:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:1.0:1789185759.887060:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:1.0:1789185759.887067:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:2371:x1876096812431360:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185759.887094:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:2371:x1876096812431360:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 29us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185759.887101:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:1.0:1789185759.887121:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812431232 00000100:00100000:1.0:1789185759.887125:0:15070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812431232 00000100:00100000:1.0:1789185759.887147:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812431488 00000100:00100000:1.0:1789185759.887150:0:15070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812431488 00000100:00100000:1.0:1789185759.887163:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812431104 00000100:00100000:1.0:1789185759.887165:0:15070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812431104 00000100:00100000:1.0:1789185759.887176:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812431616 00000100:00100000:1.0:1789185759.887178:0:15070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812431616 00000100:00100000:1.0:1789185759.887193:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:1.0:1789185759.887199:0:15070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c595249a-629e-4223-b27d-e43e596c040e+5:2371:x1876096812431232:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185759.887228:0:15070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c595249a-629e-4223-b27d-e43e596c040e+5:2371:x1876096812431232:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 29us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185759.887235:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:1.0:1789185759.887246:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:1.0:1789185759.887252:0:15070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+5:2371:x1876096812431488:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185759.887274:0:15070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+5:2371:x1876096812431488:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 23us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185759.887301:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:1.0:1789185759.887314:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:1.0:1789185759.887319:0:15070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c595249a-629e-4223-b27d-e43e596c040e+5:2371:x1876096812431104:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185759.887343:0:15070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c595249a-629e-4223-b27d-e43e596c040e+5:2371:x1876096812431104:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 24us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185759.887349:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:1.0:1789185759.887359:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:1.0:1789185759.887366:0:15070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792ff5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+5:2371:x1876096812431616:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185759.887388:0:15070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792ff5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+5:2371:x1876096812431616:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 22us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185759.887394:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00080000:1.0:1789185759.887443:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185759.887447:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185759.887450:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185759.888173:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:2371:x1876096812430848:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1789185759.888239:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:2371:x1876096812430848:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 1743us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185759.888249:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 104 00010000:00010000:3.0:1789185760.146622:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185761.172336:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185762.192503:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821858944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185762.192613:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185762.192787:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58cff117-25e2-45dd-b12f-8a52f6f341b2:3280:1876096821859072:0@lo:400:kworker.0 00000100:00100000:2.0:1789185762.192824:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185762.192851:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821859584:0@lo:400:kworker.0 00000100:00100000:2.0:1789185762.192883:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185762.192912:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185762.192917:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821859200:0@lo:400:kworker.0 00000100:00100000:2.0:1789185762.192942:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185762.192979:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821859072 00000100:00100000:2.0:1789185762.192989:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821859072 00000100:00100000:2.0:1789185762.193047:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789185762.193057:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:3280:x1876096821859072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185762.193111:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:3280:x1876096821859072:12345-0@lo:400:kworker.0 Request processed in 55us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185762.193120:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789185762.193171:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821859584 00000100:00100000:2.0:1789185762.193175:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821859584 00000100:00100000:2.0:1789185762.193217:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789185762.193223:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821859584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185762.193290:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876096821859584:12345-0@lo:400:kworker.0 Request processed in 67us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185762.193296:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789185762.193317:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821859200 00000100:00100000:2.0:1789185762.193320:0:15070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821859200 00000100:00100000:2.0:1789185762.193360:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789185762.193368:0:15070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821859200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185762.193398:0:15070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821859200:12345-0@lo:400:kworker.0 Request processed in 32us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185762.193432:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789185762.193453:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789185762.193458:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185762.193817:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821859200:0@lo:400:kworker.0 00000100:00100000:2.0:1789185762.193828:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58cff117-25e2-45dd-b12f-8a52f6f341b2:3280:1876096821859072:0@lo:400:kworker.0 00000100:00100000:2.0:1789185762.193837:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1876096821859584:0@lo:400:kworker.0 00000100:00100000:2.0:1789185762.193873:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821859456:0@lo:400:kworker.0 00000100:00100000:2.0:1789185762.193898:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185762.193918:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185762.193923:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821859328:0@lo:400:kworker.0 00000100:00100000:2.0:1789185762.193941:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789185762.194997:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185762.195498:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821858944 00000100:00100000:3.0:1789185762.195508:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821858944 00000100:00100000:3.0:1789185762.195569:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185762.195580:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821858944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185762.195621:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185762.195702:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821858944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185762.195710:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185762.195738:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821859456 00000100:00100000:3.0:1789185762.195742:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821859456 00000100:00100000:3.0:1789185762.195885:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821859328 00000100:00100000:3.0:1789185762.195890:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821859328 00000100:00100000:3.0:1789185762.195916:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789185762.195923:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821859456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185762.195961:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821859456:12345-0@lo:400:kworker.0 Request processed in 38us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185762.195968:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789185762.195980:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789185762.195986:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821859328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185762.196013:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821859328:12345-0@lo:400:kworker.0 Request processed in 27us (2070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185762.196019:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1789185762.196047:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185762.196051:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185762.203669:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821859328:0@lo:400:kworker.0 00000100:00100000:2.0:1789185762.203692:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821859456:0@lo:400:kworker.0 00000100:00100000:2.0:1789185762.203717:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821858944:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1789185763.200244:0:16503:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3009dad0 20000000:00000080:1.0:1789185763.200278:0:16503:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c7802050000 uarg=0000000000000000 20000000:01000000:1.0:1789185763.200327:0:16503:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789185763.200334:0:16503:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789185763.200340:0:16503:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789185763.204648:0:16504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1789185763.205104:0:16503:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789185763.216504:0:16503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789185763.216763:0:16503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c793fe05a00/0x532743011272cd94 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.216813:0:16503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7907355000/0x532743011272ca8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272ca84 expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.216822:0:16503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c793fe04000/0x532743011272cad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272cad1 expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.216830:0:16503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7907354600/0x532743011272cc13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272cc0c expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.216841:0:16503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c793fe04e00/0x532743011272cd32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8af expref: 12 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.216849:0:16503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7907354a00/0x532743011272cd6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d911 expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.216852:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185763.216857:0:16503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c793fe05a00/0x532743011272cd94 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.217123:0:16503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7907354a00/0x532743011272cd6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d911 expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.217143:0:16503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7907354a00/0x532743011272cd6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d911 expref: 12 pid: 14379 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185763.217161:0:16503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1876096821859712:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185763.217309:0:16503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c793fe04e00/0x532743011272cd32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8af expref: 12 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.217318:0:16503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c793fe04e00/0x532743011272cd32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8af expref: 12 pid: 14381 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185763.217335:0:16503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1876096821859840:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185763.217366:0:16503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7907354600/0x532743011272cc13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272cc0c expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.217375:0:16503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7907354600/0x532743011272cc13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272cc0c expref: 18 pid: 14380 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185763.217384:0:16503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1876096821859968:0@lo:104: 00000100:00100000:3.0:1789185763.228834:0:16503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789185763.229465:0:16503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c793fe04000/0x532743011272cad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272cad1 expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.229487:0:16503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c793fe04000/0x532743011272cad8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272cad1 expref: 18 pid: 14380 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185763.229509:0:16503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc87800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1876096821860096:0@lo:104: 00000100:00100000:3.0:1789185763.229579:0:16503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789185763.232530:0:16503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7907355000/0x532743011272ca8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x532743011272ca84 expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.232551:0:16503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7907355000/0x532743011272ca8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x532743011272ca84 expref: 18 pid: 14380 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185763.232567:0:16503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc85180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1876096821860224:0@lo:104: 00000100:00100000:3.0:1789185763.232647:0:16503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185763.238927:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821859968 00000100:00100000:1.0:1789185763.238951:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821859968 00000100:00100000:0.0:1789185763.239145:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821860096 00000100:00100000:0.0:1789185763.239150:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821860096 00000100:00100000:0.0:1789185763.239173:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789185763.239185:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58cff117-25e2-45dd-b12f-8a52f6f341b2+4:16503:x1876096821859968:12345-0@lo:104: 00010000:00010000:0.0:1789185763.239209:0:14370:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c79013ec600/0x532743011272cc0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272cc13 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.239350:0:14370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789185763.239357:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58cff117-25e2-45dd-b12f-8a52f6f341b2+4:16503:x1876096821859968:12345-0@lo:104: Request processed in 175us (10534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185763.239364:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789185763.239384:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185763.239391:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58cff117-25e2-45dd-b12f-8a52f6f341b2+3:16503:x1876096821860096:12345-0@lo:104: 00010000:00010000:0.0:1789185763.239399:0:14370:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c793fe04200/0x532743011272cad1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272cad8 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.239464:0:14370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789185763.239485:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58cff117-25e2-45dd-b12f-8a52f6f341b2+3:16503:x1876096821860096:12345-0@lo:104: Request processed in 96us (9906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185763.239492:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789185763.239510:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185763.239517:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c79013ec600/0x532743011272cc0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272cc13 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.239525:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ec600 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:0.0:1789185763.239529:0:14375:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c79013ec600/0x532743011272cc0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272cc13 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.239538:0:14375:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79013ec600/0x532743011272cc0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272cc13 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185763.239545:0:14375:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79013ec600/0x532743011272cc0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272cc13 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185763.239553:0:14375:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789185763.239615:0:14375:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c79013ec600/0x532743011272cc0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272cc13 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.239622:0:14375:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185763.239657:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c79013ec600/0x532743011272cc0c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272cc13 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.239664:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79013ec600/0x532743011272cc0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272cc13 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.239686:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185763.239689:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c793fe04200/0x532743011272cad1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272cad8 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.239707:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:0.0:1789185763.239711:0:14375:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c793fe04200/0x532743011272cad1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272cad8 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.239717:0:14375:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c793fe04200/0x532743011272cad1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272cad8 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185763.239724:0:14375:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c793fe04200/0x532743011272cad1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272cad8 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185763.239729:0:14375:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789185763.239743:0:14375:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c793fe04200/0x532743011272cad1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272cad8 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.239749:0:14375:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185763.239769:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c793fe04200/0x532743011272cad1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272cad8 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.239776:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c793fe04200/0x532743011272cad1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272cad8 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.239787:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185763.239789:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185763.239791:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185763.239820:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58cff117-25e2-45dd-b12f-8a52f6f341b2:3281:1876096821860352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185763.239866:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185763.239923:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793ff96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58cff117-25e2-45dd-b12f-8a52f6f341b2:3278:1876096821860480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185763.239949:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185763.239995:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821860352 00000100:00100000:0.0:1789185763.240000:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821860352 00010000:00010000:0.0:1789185763.240022:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7907354600/0x532743011272cc13 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272cc0c expref: 19 pid: 14380 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185763.240044:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821860480 00000100:00100000:0.0:1789185763.240046:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821860480 00010000:00010000:0.0:1789185763.240057:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c793fe04000/0x532743011272cad8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272cad1 expref: 20 pid: 14380 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185763.240069:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789185763.240075:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58cff117-25e2-45dd-b12f-8a52f6f341b2+20:3281:x1876096821860352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185763.240088:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185763.240093:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7907354600/0x532743011272cc13 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272cc0c expref: 20 pid: 14380 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.240102:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7907354600/0x532743011272cc13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272cc0c expref: 20 pid: 14380 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.240123:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185763.240152:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58cff117-25e2-45dd-b12f-8a52f6f341b2+20:3281:x1876096821860352:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185763.240158:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789185763.240170:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185763.240176:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:3278:x1876096821860480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185763.240184:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185763.240188:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c793fe04000/0x532743011272cad8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272cad1 expref: 19 pid: 14380 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.240196:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c793fe04000/0x532743011272cad8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272cad1 expref: 19 pid: 14380 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.240213:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185763.240238:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:3278:x1876096821860480:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185763.240245:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185763.240302:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58cff117-25e2-45dd-b12f-8a52f6f341b2:3278:1876096821860480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185763.240327:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793ff94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58cff117-25e2-45dd-b12f-8a52f6f341b2:3281:1876096821860352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789185763.242676:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185763.248807:0:16503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907e730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185763.248861:0:16503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1876096821859712:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185763.248910:0:16503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1876096821859840:192.168.202.54@tcp:104: 00010000:00010000:3.0:1789185763.248924:0:16503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7907354600/0x532743011272cc13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272cc0c expref: 18 pid: 14380 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185763.248945:0:16503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1876096821859968:0@lo:104: 00010000:00010000:3.0:1789185763.248957:0:16503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c793fe04000/0x532743011272cad8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272cad1 expref: 17 pid: 14380 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185763.249226:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185763.249289:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812431744 00000100:00100000:1.0:1789185763.249307:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812431744 00010000:00010000:1.0:1789185763.249361:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7907354a00/0x532743011272cd6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d911 expref: 13 pid: 14379 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185763.249402:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:1.0:1789185763.249446:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792feda050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:2371:x1876096812431744:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185763.249464:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185763.249471:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7907354a00/0x532743011272cd6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d911 expref: 13 pid: 14379 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.249488:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7907354a00/0x532743011272cd6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d911 expref: 13 pid: 14379 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.249508:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7907354a00/0x532743011272cd6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d911 expref: 13 pid: 14379 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.249522:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185763.249586:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792feda050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+12:2371:x1876096812431744:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 142us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.249594:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:3.0:1789185763.249987:0:16503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc87800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1876096821860096:0@lo:104: 00000100:00100000:2.0:1789185763.253732:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821860224 00000100:00100000:2.0:1789185763.253754:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821860224 00000100:00100000:2.0:1789185763.253883:0:14369:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789185763.253915:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789185763.253927:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7941ca6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58cff117-25e2-45dd-b12f-8a52f6f341b2+3:16503:x1876096821860224:12345-0@lo:104: 00010000:00010000:2.0:1789185763.253950:0:14369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9c79073fe400/0x532743011272ca84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ca8b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.254087:0:14369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789185763.254094:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7941ca6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58cff117-25e2-45dd-b12f-8a52f6f341b2+3:16503:x1876096821860224:12345-0@lo:104: Request processed in 170us (21446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185763.254102:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789185763.256818:0:15669:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185763.256840:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9c79073fe400/0x532743011272ca84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x532743011272ca8b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.256855:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79073fe400 already unused, calling callback (ffffffffc1d41c20) 10000000:00010000:1.0:1789185763.256860:0:15669:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9c79073fe400/0x532743011272ca84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x532743011272ca8b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.256872:0:15669:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9c79073fe400/0x532743011272ca84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x532743011272ca8b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185763.256906:0:15669:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9c79073fe400/0x532743011272ca84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x532743011272ca8b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185763.256914:0:15669:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789185763.257086:0:15669:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9c79073fe400/0x532743011272ca84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ca8b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.257095:0:15669:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789185763.257123:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9c79073fe400/0x532743011272ca84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ca8b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.257130:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9c79073fe400/0x532743011272ca84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x532743011272ca8b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.257159:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185763.257162:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185763.257164:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185763.257188:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58cff117-25e2-45dd-b12f-8a52f6f341b2:3279:1876096821860608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789185763.257282:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185763.257365:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821860608 00000100:00100000:1.0:1789185763.257374:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821860608 00010000:00010000:1.0:1789185763.257437:0:14372:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7907355000/0x532743011272ca8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ca84 expref: 17 pid: 14380 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185763.257472:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185763.257483:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:3279:x1876096821860608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789185763.257498:0:14372:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185763.257503:0:14372:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7907355000/0x532743011272ca8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x532743011272ca84 expref: 17 pid: 14380 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.257522:0:14372:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7907355000/0x532743011272ca8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x532743011272ca84 expref: 17 pid: 14380 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.257542:0:14372:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185763.257576:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:3279:x1876096821860608:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.257584:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185763.257626:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58cff117-25e2-45dd-b12f-8a52f6f341b2:3279:1876096821860608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185763.258948:0:16503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7907355000/0x532743011272ca8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x532743011272ca84 expref: 16 pid: 14380 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185763.258969:0:16503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc85180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1876096821860224:0@lo:104: 00010000:00010000:3.0:1789185763.259023:0:16503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c793fe05a00/0x532743011272cd94 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185763.285186:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185763.285313:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812431872 00000100:00100000:1.0:1789185763.285337:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812431872 00010000:00010000:1.0:1789185763.285394:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c793fe04e00/0x532743011272cd32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8af expref: 12 pid: 14381 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185763.285490:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:1.0:1789185763.285503:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+12:2372:x1876096812431872:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185763.285524:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185763.285531:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c793fe04e00/0x532743011272cd32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8af expref: 12 pid: 14381 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.285549:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c793fe04e00/0x532743011272cd32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8af expref: 12 pid: 14381 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.285582:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c793fe04e00/0x532743011272cd32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8af expref: 12 pid: 14381 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.285604:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c793fe05a00/0x532743011272cd94 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.285640:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe05a00/0x532743011272cd94 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.285662:0:14373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c793fe05a00/0x532743011272cd94 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.285670:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c793fe05a00/0x532743011272cd94 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.285679:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c793fe05a00/0x532743011272cd94 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.285688:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c793fe05a00/0x532743011272cd94 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.285695:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05a00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185763.285699:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c793fe05a00/0x532743011272cd94 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.285708:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c793fe05a00/0x532743011272cd94 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.285729:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c793fe05a00/0x532743011272cd94 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.285741:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185763.285818:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+11:2372:x1876096812431872:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 317us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.285826:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00010000:00010000:3.0:1789185763.289118:0:16503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c793fe05a00/0x532743011272cd94 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.289144:0:16503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c793fe05a00/0x532743011272cd94 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.289153:0:16503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c793fe05a00/0x532743011272cd94 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185764.239705:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185764.240568:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821860736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185764.240662:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185764.240800:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821860736 00000100:00100000:3.0:1789185764.240813:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821860736 00000100:00100000:3.0:1789185764.240912:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185764.240925:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821860736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185764.241006:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789185764.241097:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185764.242423:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821860736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1480us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185764.242438:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789185764.242726:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821860736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185764.360539:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185764.360757:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812432000 00000100:00100000:3.0:1789185764.360771:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812432000 00000100:00100000:3.0:1789185764.360851:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:3.0:1789185764.360864:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f1e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+11:13786:x1876096812432000:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185764.360904:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185764.360932:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe05a00/0x532743011272cd9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d942 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.360973:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe05a00/0x532743011272cd9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d942 expref: 12 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.360988:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe05a00/0x532743011272cd9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d942 expref: 12 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.360999:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05a00, rc 0) 00000100:00100000:3.0:1789185764.361077:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f1e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+12:13786:x1876096812432000:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 216us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185764.361085:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:3.0:1789185764.373100:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185764.373440:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812432128 00000100:00100000:0.0:1789185764.373456:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812432128 00000100:00100000:0.0:1789185764.373533:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 107 00000100:00100000:0.0:1789185764.373546:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+12:13786:x1876096812432128:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185764.373957:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+12:13786:x1876096812432128:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 412us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185764.373967:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 107 00000100:00100000:0.0:1789185764.376732:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185764.376777:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812432256 00000100:00100000:0.0:1789185764.376788:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812432256 00000100:00100000:0.0:1789185764.376845:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:0.0:1789185764.376855:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+12:13786:x1876096812432256:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185764.377461:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+12:13786:x1876096812432256:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 605us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185764.377479:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:0.0:1789185764.393034:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185764.393276:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812432384 00000100:00100000:3.0:1789185764.393291:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812432384 00000100:00100000:3.0:1789185764.393363:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:3.0:1789185764.393375:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+12:13786:x1876096812432384:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185764.393460:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185764.393485:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe04000/0x532743011272cda2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d949 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.393522:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe04000/0x532743011272cda2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d949 expref: 13 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.393535:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe04000/0x532743011272cda2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d949 expref: 13 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.393546:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04000, rc 0) 00000100:00100000:3.0:1789185764.393636:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:13786:x1876096812432384:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 263us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185764.393644:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:0.0:1789185764.397188:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185764.398703:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812432512 00000100:00100000:2.0:1789185764.398723:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812432512 00000100:00100000:2.0:1789185764.398805:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00100000:2.0:1789185764.398816:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:13786:x1876096812432512:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185764.399223:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:13786:x1876096812432512:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 407us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185764.399231:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00100000:0.0:1789185764.405257:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185764.405361:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812432640 00000100:00100000:2.0:1789185764.405375:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812432640 00000100:00100000:2.0:1789185764.405467:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 111 00000100:00100000:2.0:1789185764.405560:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:13786:x1876096812432640:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185764.405850:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:13786:x1876096812432640:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 293us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185764.413302:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 111 10000000:01000000:1.0:1789185764.431516:0:14383:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789185764.431527:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c791f9a0800 from 10 10000000:01000000:1.0:1789185764.431536:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789185764.431607:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272cda9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.431621:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272cda9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.431635:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272cda9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185764.431669:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821860864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789185764.431761:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185764.431829:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c790685a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789185764.431898:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821860864 00000100:00100000:2.0:1789185764.431909:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821860864 00000100:00100000:2.0:1789185764.431977:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789185764.431988:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+16:14383:x1876096821860864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185764.432007:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185764.432025:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d7e00/0x532743011272cdb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272cda9 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.432056:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d7e00/0x532743011272cdb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272cda9 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.432068:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d7e00/0x532743011272cdb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272cda9 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.432079:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7e00, rc 0) 00000100:00100000:2.0:1789185764.432134:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:14383:x1876096821860864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185764.432141:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789185764.432276:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821860864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185764.432294:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272cda9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cdb0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.432305:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272cda9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272cdb0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185764.432370:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821860992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185764.432399:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185764.432464:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c790685a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789185764.432585:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821860992 00000100:00100000:2.0:1789185764.432589:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821860992 00000100:00100000:2.0:1789185764.432619:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789185764.432625:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:14383:x1876096821860992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185764.432939:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:14383:x1876096821860992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 314us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185764.432947:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789185764.433285:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821860992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185764.433327:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821861120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185764.433381:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185764.433449:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c790685a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789185764.433519:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821861120 00000100:00100000:3.0:1789185764.433524:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821861120 00000100:00100000:3.0:1789185764.433557:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789185764.433565:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:14383:x1876096821861120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185764.433750:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:14383:x1876096821861120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185764.433757:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789185764.433941:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821861120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789185764.434765:0:16527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789185764.435298:0:14383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789185764.435324:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789185764.435338:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272cda9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cdb0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.435352:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79013ece00/0x532743011272cda9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cdb0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185764.435364:0:14383:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789185764.435368:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c79101b0000 from 10 10000000:01000000:1.0:1789185764.435372:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789185764.435440:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013eca00/0x532743011272cdb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.435449:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79013eca00/0x532743011272cdb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.435461:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79013eca00/0x532743011272cdb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185764.435483:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821861248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789185764.435547:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185764.435590:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c790685a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789185764.437308:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821861248 00000100:00100000:2.0:1789185764.437326:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821861248 00000100:00100000:2.0:1789185764.437395:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789185764.437422:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+17:14383:x1876096821861248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185764.437441:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185764.437463:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c79234d7200/0x532743011272cdbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272cdb7 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.437497:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c79234d7200/0x532743011272cdbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272cdb7 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.437510:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c79234d7200/0x532743011272cdbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272cdb7 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.437519:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7200, rc 0) 00000100:00100000:2.0:1789185764.437605:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:14383:x1876096821861248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185764.437613:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789185764.437685:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821861248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185764.437705:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79013eca00/0x532743011272cdb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cdbe expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.437715:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79013eca00/0x532743011272cdb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272cdbe expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185764.437796:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821861376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185764.437835:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185764.437856:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185764.437883:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821861376 00000100:00100000:2.0:1789185764.437887:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821861376 00000100:00100000:2.0:1789185764.437910:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789185764.437916:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c79072ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:14383:x1876096821861376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185764.438218:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c79072ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:14383:x1876096821861376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185764.438226:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789185764.438270:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821861376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185764.438313:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821861504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185764.438354:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185764.438368:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185764.438381:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821861504 00000100:00100000:2.0:1789185764.438384:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821861504 00000100:00100000:2.0:1789185764.438430:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789185764.438439:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:14383:x1876096821861504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185764.438608:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:14383:x1876096821861504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185764.438615:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789185764.438652:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821861504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789185764.454928:0:16528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789185764.456210:0:14383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789185764.456323:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789185764.456338:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79013eca00/0x532743011272cdb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cdbe expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.456356:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79013eca00/0x532743011272cdb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cdbe expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185764.456390:0:14383:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789185764.456393:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c793f283000 from 10 10000000:01000000:2.0:1789185764.456396:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789185764.457147:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d7c00/0x532743011272cdc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.457163:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9c79234d7c00/0x532743011272cdc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.457177:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9c79234d7c00/0x532743011272cdc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185764.457212:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821861632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789185764.457621:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185764.462522:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185764.466689:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821861632 00000100:00100000:3.0:1789185764.466709:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821861632 00000100:00100000:3.0:1789185764.466798:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789185764.466811:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+18:14383:x1876096821861632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185764.466831:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185764.466874:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c793fe04c00/0x532743011272cdcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x532743011272cdc5 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.467044:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c793fe04c00/0x532743011272cdcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x532743011272cdc5 expref: 19 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.467060:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c793fe04c00/0x532743011272cdcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x532743011272cdc5 expref: 19 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.467072:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04c00, rc 0) 00000100:00100000:3.0:1789185764.467217:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:14383:x1876096821861632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 408us (9597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185764.467224:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789185764.472498:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821861632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185764.472541:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9c79234d7c00/0x532743011272cdc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cdcc expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.472556:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9c79234d7c00/0x532743011272cdc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x532743011272cdcc expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185764.472673:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821861760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185764.472754:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185764.472811:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185764.472937:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821861760 00000100:00100000:3.0:1789185764.472947:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821861760 00000100:00100000:3.0:1789185764.473006:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789185764.473017:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:14383:x1876096821861760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185764.473384:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:14383:x1876096821861760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 367us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185764.473392:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789185764.473751:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821861760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185764.473790:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821861888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185764.473843:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185764.473869:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7907c82d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185764.476100:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821861888 00000100:00100000:3.0:1789185764.476118:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821861888 00000100:00100000:3.0:1789185764.476194:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789185764.476206:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:14383:x1876096821861888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185764.476645:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:14383:x1876096821861888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 441us (2801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185764.476654:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789185764.476765:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58cff117-25e2-45dd-b12f-8a52f6f341b2:14383:1876096821861888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789185764.485681:0:16530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789185764.486045:0:14383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789185764.486088:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789185764.486103:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9c79234d7c00/0x532743011272cdc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cdcc expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185764.486120:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9c79234d7c00/0x532743011272cdc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x532743011272cdcc expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185765.001120:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185765.001169:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185765.001199:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185765.001256:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185765.001276:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185765.001302:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185765.001338:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812433152 00000100:00100000:1.0:1789185765.001351:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812433152 00000100:00100000:1.0:1789185765.001474:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812432768 00000100:00100000:1.0:1789185765.001478:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812432768 00000100:00100000:1.0:1789185765.001510:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:1.0:1789185765.001522:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:2372:x1876096812433152:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185765.001628:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:2372:x1876096812433152:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 108us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185765.001637:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:1.0:1789185765.001658:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1789185765.001666:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+6:2372:x1876096812432768:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185765.001692:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+6:2372:x1876096812432768:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 27us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185765.001699:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1789185765.001719:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812432896 00000100:00100000:1.0:1789185765.001723:0:16267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812432896 00000100:00100000:1.0:1789185765.001744:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812433408 00000100:00100000:1.0:1789185765.001747:0:16267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812433408 00000100:00100000:1.0:1789185765.001759:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812433024 00000100:00100000:1.0:1789185765.001761:0:16267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812433024 00000100:00100000:1.0:1789185765.001772:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812433280 00000100:00100000:1.0:1789185765.001775:0:16267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812433280 00000100:00100000:1.0:1789185765.001791:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1789185765.001798:0:16267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c595249a-629e-4223-b27d-e43e596c040e+5:2372:x1876096812432896:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185765.001825:0:16267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c595249a-629e-4223-b27d-e43e596c040e+5:2372:x1876096812432896:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 27us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185765.001839:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1789185765.001853:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789185765.001859:0:16267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+5:2372:x1876096812433408:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185765.001884:0:16267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+5:2372:x1876096812433408:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 25us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185765.001890:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1789185765.001900:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1789185765.001906:0:16267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c595249a-629e-4223-b27d-e43e596c040e+5:2372:x1876096812433024:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185765.001942:0:16267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c595249a-629e-4223-b27d-e43e596c040e+5:2372:x1876096812433024:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 36us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185765.001949:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1789185765.001961:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:1.0:1789185765.001968:0:16267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+5:2372:x1876096812433280:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1789185765.001991:0:16267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+5:2372:x1876096812433280:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 24us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185765.001998:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00080000:1.0:1789185765.002025:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185765.002030:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185765.002032:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789185765.280024:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789185765.776304:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789185766.291735:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185767.312055:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185767.312358:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58cff117-25e2-45dd-b12f-8a52f6f341b2:3281:1876096821862016:0@lo:400:kworker.0 00000100:00100000:1.0:1789185767.312462:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185767.312506:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821862528:0@lo:400:kworker.0 00000100:00100000:1.0:1789185767.312545:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185767.312576:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185767.312582:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821862400:0@lo:400:kworker.0 00000100:00100000:1.0:1789185767.312611:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185767.312653:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821862144:0@lo:400:kworker.0 00000100:00100000:1.0:1789185767.312678:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185767.312693:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821862656:0@lo:400:kworker.0 00000100:00100000:1.0:1789185767.312710:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185767.312724:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789185767.312728:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821862272:0@lo:400:kworker.0 00000100:00100000:1.0:1789185767.312744:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185767.312757:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821862784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185767.312773:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185767.312801:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821862528 00000100:00100000:1.0:1789185767.312808:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821862528 00000100:00100000:1.0:1789185767.312852:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821862400 00000100:00100000:1.0:1789185767.312855:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821862400 00000100:00100000:1.0:1789185767.312868:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821862656 00000100:00100000:1.0:1789185767.312870:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821862656 00000100:00100000:1.0:1789185767.312886:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789185767.312894:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821862528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185767.312941:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876096821862528:12345-0@lo:400:kworker.0 Request processed in 48us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185767.312948:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789185767.312966:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789185767.312972:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821862400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185767.313012:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876096821862400:12345-0@lo:400:kworker.0 Request processed in 42us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185767.313018:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789185767.313031:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789185767.313037:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821862656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185767.313066:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876096821862656:12345-0@lo:400:kworker.0 Request processed in 29us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185767.313071:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789185767.313092:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821862144 00000100:00100000:1.0:1789185767.313095:0:16267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821862144 00000100:00100000:1.0:1789185767.313118:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821862272 00000100:00100000:1.0:1789185767.313120:0:16267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821862272 00000100:00100000:1.0:1789185767.313139:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789185767.313145:0:16267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821862144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185767.313178:0:16267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821862144:12345-0@lo:400:kworker.0 Request processed in 34us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185767.313184:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789185767.313195:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185767.313200:0:16267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821862272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185767.313237:0:16267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821862272:12345-0@lo:400:kworker.0 Request processed in 37us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185767.313242:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185767.313270:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821862784 00000100:00100000:1.0:1789185767.313273:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821862784 00000100:00100000:1.0:1789185767.313295:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789185767.313302:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821862784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185767.313341:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789185767.313370:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876096821862784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185767.313376:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789185767.313392:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185767.313396:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185767.313398:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185767.313461:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821862272:0@lo:400:kworker.0 00000100:00100000:1.0:1789185767.313476:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821862784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185767.313485:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1876096821862144:0@lo:400:kworker.0 00000100:00100000:1.0:1789185767.313494:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1876096821862656:0@lo:400:kworker.0 00000100:00100000:1.0:1789185767.313528:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876096821862400:0@lo:400:kworker.0 00000100:00100000:1.0:1789185767.313538:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1876096821862528:0@lo:400:kworker.0 00000100:00100000:2.0:1789185767.313777:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821862016 00000100:00100000:2.0:1789185767.313782:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821862016 00000100:00100000:2.0:1789185767.313818:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789185767.313825:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:3281:x1876096821862016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185767.313865:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:3281:x1876096821862016:12345-0@lo:400:kworker.0 Request processed in 40us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185767.313871:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789185767.313904:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58cff117-25e2-45dd-b12f-8a52f6f341b2:3281:1876096821862016:0@lo:400:kworker.0 00000100:00100000:1.0:1789185768.062820:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185768.062985:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812433536 00000100:00100000:2.0:1789185768.062995:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812433536 00000100:00100000:2.0:1789185768.063082:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:2.0:1789185768.063094:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+6:14446:x1876096812433536:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185768.063113:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185768.063137:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272cdd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d950 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063201:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6c00/0x532743011272cdda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063226:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6c00/0x532743011272cdda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063242:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6c00/0x532743011272cdda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063272:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272cde1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063280:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272cde1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063287:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272cde1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063629:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272cde8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063639:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272cde8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063647:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272cde8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185768.063668:0:14386:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789185768.063672:0:14386:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789185768.063704:0:14386:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272cde8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063714:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6c00/0x532743011272cdda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063720:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6c00/0x532743011272cdda lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063727:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6c00/0x532743011272cdda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063743:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185768.063747:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6c00/0x532743011272cdda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063755:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6c00/0x532743011272cdda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063768:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:2.0:1789185768.063771:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185768.063776:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6c00/0x532743011272cdda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063782:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6c00/0x532743011272cdda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063796:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272cde1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063802:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272cde1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063807:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272cde1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063813:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185768.063816:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272cde1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063823:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272cde1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063842:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c7921169100) 00010000:00010000:2.0:1789185768.063844:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185768.063847:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272cde1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063868:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6600/0x532743011272cde1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063898:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272cdd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d950 expref: 8 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063911:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6000/0x532743011272cde8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d950 expref: 7 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.063918:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7921169600) 00010000:00010000:2.0:1789185768.063920:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185768.063922:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6000, rc 0) 00000100:00100000:2.0:1789185768.063987:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+7:14446:x1876096812433536:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 896us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185768.063994:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00080000:1.0:1789185768.065340:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185768.070384:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185768.070536:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812433792 00000100:00100000:1.0:1789185768.070547:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812433792 00000100:00100000:1.0:1789185768.070600:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:1.0:1789185768.070611:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+7:14446:x1876096812433792:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185768.070632:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185768.070657:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272cdef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d957 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.070732:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cdf6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.070759:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cdf6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.070774:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cdf6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.070789:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272cdfd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.070796:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272cdfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.070803:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272cdfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071148:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013eda00/0x532743011272ce04 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071157:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013eda00/0x532743011272ce04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071164:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013eda00/0x532743011272ce04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185768.071174:0:14387:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789185768.071381:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cdf6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071389:0:14387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cdf6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071395:0:14387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cdf6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071454:0:14387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ed800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185768.071458:0:14387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cdf6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071467:0:14387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cdf6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071480:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7921169600) 00010000:00010000:1.0:1789185768.071483:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185768.071488:0:14387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cdf6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071495:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cdf6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071508:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272cdfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071514:0:14387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272cdfd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071520:0:14387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272cdfd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071525:0:14387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013edc00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185768.071528:0:14387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272cdfd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071534:0:14387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272cdfd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071550:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c7918bab600) 00010000:00010000:1.0:1789185768.071553:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185768.071556:0:14387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272cdfd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071562:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272cdfd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.071989:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272cdef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d957 expref: 10 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.072004:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013eda00/0x532743011272ce04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d957 expref: 9 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.072012:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7918bab800) 00010000:00010000:1.0:1789185768.072014:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185768.072017:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013eda00, rc 0) 00000100:00100000:1.0:1789185768.072074:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+9:14446:x1876096812433792:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1464us (1701us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789185768.072082:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:0.0:1789185768.087125:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185768.087324:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812433920 00000100:00100000:2.0:1789185768.087343:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812433920 00000100:00100000:2.0:1789185768.087475:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:2.0:1789185768.087493:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+9:14446:x1876096812433920:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789185768.087629:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+9:14446:x1876096812433920:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 Request processed in 143us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185768.087636:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:0.0:1789185768.171614:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185768.171777:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812434048 00000100:00100000:3.0:1789185768.171850:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812434048 00000100:00100000:3.0:1789185768.172001:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:3.0:1789185768.172015:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+9:14452:x1876096812434048:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185768.172044:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185768.172072:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d95e expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172160:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172178:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172193:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172219:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172228:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172234:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172555:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172565:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172586:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172593:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185768.172598:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172607:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172622:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:3.0:1789185768.172626:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185768.172632:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172638:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172652:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172658:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172665:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172670:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185768.172673:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.172691:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.173030:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c79055dde00) 00010000:00010000:3.0:1789185768.173033:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185768.173036:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.173042:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.173087:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce12 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d95e expref: 10 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.173100:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:3.0:1789185768.173113:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185768.173117:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d95e expref: 10 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.173126:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04200, rc 0) 00000100:00100000:3.0:1789185768.173221:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+9:14452:x1876096812434048:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1208us (1623us total) trans 0 rc 301/301 00000100:00100000:3.0:1789185768.173230:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:0.0:1789185768.185098:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185768.185361:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812434176 00000100:00100000:3.0:1789185768.185375:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812434176 00000100:00100000:3.0:1789185768.185621:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:3.0:1789185768.185635:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c595249a-629e-4223-b27d-e43e596c040e+9:14452:x1876096812434176:12345-192.168.202.54@tcp:700:lfs.0 00000100:00100000:3.0:1789185768.186048:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c595249a-629e-4223-b27d-e43e596c040e+9:14452:x1876096812434176:12345-192.168.202.54@tcp:700:lfs.0 Request processed in 414us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185768.186058:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:0.0:1789185768.188514:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185768.195108:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812434432 00000100:00100000:3.0:1789185768.195131:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812434432 00000100:00100000:2.0:1789185768.195441:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:2.0:1789185768.195456:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+9:14452:x1876096812434432:12345-192.168.202.54@tcp:36:lfs.0 00010000:00010000:2.0:1789185768.195536:0:15092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185768.195570:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272cd55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d8d9 expref: 9 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.195596:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:2.0:1789185768.195602:0:15092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185768.196513:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272ce27 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.196534:0:15092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272cd8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d93b expref: 5 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.196544:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272ce27 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.196588:0:15092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272cd8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d93b expref: 5 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.196608:0:15092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272cd8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d93b expref: 5 pid: 14387 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185768.196625:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15092:1876096821862912:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185768.196776:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185768.200691:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15092:1876096821862912:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789185768.200748:0:15092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272ce27 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185768.202532:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185768.202706:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812434560 00000100:00100000:1.0:1789185768.202719:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812434560 00010000:00010000:1.0:1789185768.202803:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272cd8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d93b expref: 6 pid: 14387 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185768.202843:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1789185768.202852:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:2372:x1876096812434560:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185768.202961:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185768.202970:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272cd8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d93b expref: 6 pid: 14387 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.202984:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272cd8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d93b expref: 6 pid: 14387 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.203007:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272cd8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d93b expref: 6 pid: 14387 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.203023:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:1.0:1789185768.203028:0:14371:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272ce27 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.203037:0:14371:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272ce27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.203044:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272ce27 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.203076:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185768.203128:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+5:2372:x1876096812434560:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 278us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185768.203133:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00010000:00010000:3.0:1789185768.203198:0:15092:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272ce27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.203219:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272ce27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.203252:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce2e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.203263:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.203273:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789185768.204034:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1789185768.205848:0:15092:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789185768.205870:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272ce27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.205882:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272ce27 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.207858:0:15092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272ce27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.207879:0:15092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185768.207884:0:15092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272ce27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.207950:0:15092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272ce27 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.207973:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c79055ddc00) 00010000:00010000:2.0:1789185768.207976:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185768.207982:0:15092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272ce27 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.207990:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272ce27 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185768.208026:0:15092:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003d0c3d1c reply state 0000000025d50fb2 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185768.208038:0:15092:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185768.208170:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+10:14452:x1876096812434432:12345-192.168.202.54@tcp:36:lfs.0 Request processed in 12713us (19667us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789185768.208198:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00010000:00010000:2.0:1789185768.225235:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.225256:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce2e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.225265:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce2e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.225271:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185768.225277:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce2e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.225286:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce2e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.225307:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c79055dde00) 00010000:00010000:2.0:1789185768.225310:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185768.225316:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce2e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.225322:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce2e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185768.321614:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185768.321734:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812434688 00000100:00100000:1.0:1789185768.321749:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812434688 00000100:00100000:1.0:1789185768.321833:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:1.0:1789185768.321847:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+9:14460:x1876096812434688:12345-192.168.202.54@tcp:101:lctl.0 00010000:00010000:1.0:1789185768.322029:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185768.322060:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272ce35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d965 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.322143:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272ce3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.322160:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272ce3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.322174:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272ce3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185768.322232:0:14387:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789185768.322237:0:14387:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789185768.322287:0:14387:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272ce3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.322319:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec000/0x532743011272ce35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d965 expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.322342:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013edc00/0x532743011272ce3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d965 expref: 10 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185768.322351:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7918bab600) 00010000:00010000:1.0:1789185768.322355:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789185768.322359:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013edc00, rc 0) 00000100:00100000:1.0:1789185768.322557:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+10:14460:x1876096812434688:12345-192.168.202.54@tcp:101:lctl.0 Request processed in 712us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185768.322577:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00010000:00010000:0.0:1789185768.335664:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185768.345763:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185768.346286:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812434816 00000100:00100000:1.0:1789185768.346302:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812434816 00000100:00100000:1.0:1789185768.346391:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:1.0:1789185768.346599:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+5:14461:x1876096812434816:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789185768.346744:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185768.346779:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272ce43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d96c expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185768.347230:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272ce4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185768.347274:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272ce4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185768.347290:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272ce4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185768.347342:0:14386:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789185768.347347:0:14386:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789185768.347374:0:14386:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272ce4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185768.347446:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355600/0x532743011272ce43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d96c expref: 7 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185768.347470:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355000/0x532743011272ce4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d96c expref: 6 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185768.347480:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7918bab600) 00010000:00010000:0.0:1789185768.347484:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185768.347489:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355000, rc 0) 00000100:00100000:0.0:1789185768.347582:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:14461:x1876096812434816:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1180us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185768.347591:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:0.0:1789185768.355247:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185768.355342:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812434944 00000100:00100000:3.0:1789185768.355356:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812434944 00000100:00100000:3.0:1789185768.355478:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:3.0:1789185768.355492:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+6:14461:x1876096812434944:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185768.355521:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185768.355550:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d973 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.355642:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.355682:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.355697:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.355721:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.355729:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.355737:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.355869:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272ce66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.355878:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272ce66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.355885:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272ce66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185768.356274:0:14388:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789185768.356279:0:14388:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789185768.356310:0:14388:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272ce66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356327:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356349:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356357:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356365:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185768.356370:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356379:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356395:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7918bab600) 00010000:00010000:3.0:1789185768.356398:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185768.356592:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356601:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272ce58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356619:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356626:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356631:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356636:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185768.356646:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356653:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356663:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c79055ddb00) 00010000:00010000:3.0:1789185768.356666:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185768.356669:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356676:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272ce5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356725:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d973 expref: 8 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356743:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272ce66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d973 expref: 7 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.356750:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c79055dd600) 00010000:00010000:3.0:1789185768.356752:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789185768.356755:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe05400, rc 0) 00000100:00100000:3.0:1789185768.356912:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+7:14461:x1876096812434944:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1413us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185768.356922:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:2.0:1789185768.368082:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185768.378438:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812435200 00000100:00100000:0.0:1789185768.378462:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812435200 00000100:00100000:0.0:1789185768.378574:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:0.0:1789185768.378588:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+7:14461:x1876096812435200:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1789185768.378638:0:15092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185768.378670:0:15092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272ce6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d97a expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185768.378800:0:15092:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789185768.380612:0:15092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272ce6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d97a expref: 9 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185768.380636:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7918bab600) 00010000:00010000:0.0:1789185768.380640:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789185768.380646:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355a00/0x532743011272ce6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d97a expref: 9 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185768.380664:0:15092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355a00, rc 0) 00000100:00100000:0.0:1789185768.380835:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+8:14461:x1876096812435200:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 2249us (12765us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789185768.380845:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1789185768.392784:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185768.393126:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812435456 00000100:00100000:3.0:1789185768.393141:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812435456 00000100:00100000:3.0:1789185768.393232:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:3.0:1789185768.393242:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+8:14461:x1876096812435456:12345-192.168.202.54@tcp:36:lfs.0 00010000:00010000:3.0:1789185768.393322:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185768.393353:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272ce66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d973 expref: 8 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.393377:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c79055dd600) 00010000:00010000:3.0:1789185768.393390:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185768.393456:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce7b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.393474:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.393487:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185768.394524:0:14387:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008484ec77 reply state 00000000e5147c62 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185768.394544:0:14387:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789185768.394557:0:14387:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789185768.394677:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+9:14461:x1876096812435456:12345-192.168.202.54@tcp:36:lfs.0 Request processed in 1432us (1901us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789185768.394686:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00010000:00010000:0.0:1789185768.398564:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185768.398589:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce7b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185768.398598:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185768.398605:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185768.398611:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185768.398640:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce7b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185768.398664:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c79055ddb00) 00010000:00010000:0.0:1789185768.398668:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789185768.398675:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce7b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185768.398683:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ce7b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185768.398877:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185768.399319:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812435712 00000100:00100000:3.0:1789185768.399333:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812435712 00000100:00100000:3.0:1789185768.399401:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:3.0:1789185768.399488:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+8:14461:x1876096812435712:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789185768.403461:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+9:14461:x1876096812435712:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 3956us (4579us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789185768.403512:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:1.0:1789185768.413856:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185768.413962:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812435968 00000100:00100000:2.0:1789185768.413975:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812435968 00000100:00100000:2.0:1789185768.414047:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:2.0:1789185768.414060:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+9:14461:x1876096812435968:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185768.414114:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185768.414142:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272ce82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d981 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414254:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ce89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414274:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ce89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414289:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ce89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414307:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272ce90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414314:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272ce90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414322:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272ce90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185768.414500:0:14386:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789185768.414634:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ce89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414643:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ce89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414650:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ce89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414668:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185768.414673:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ce89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414682:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ce89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414695:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7918bab600) 00010000:00010000:2.0:1789185768.414698:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185768.414703:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ce89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414710:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ce89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414726:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272ce90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414732:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272ce90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414738:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272ce90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414744:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185768.414747:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272ce90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414752:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272ce90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414768:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c7921169100) 00010000:00010000:2.0:1789185768.414770:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185768.414773:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272ce90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414779:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272ce90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414821:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272ce82 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d981 expref: 11 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414831:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7918bab600) 00010000:00010000:2.0:1789185768.414833:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185768.414836:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272ce82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d981 expref: 11 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.414846:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6e00, rc 0) 00000100:00100000:2.0:1789185768.414916:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+10:14461:x1876096812435968:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 858us (1086us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789185768.414925:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:2.0:1789185768.418707:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185768.418844:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812436096 00000100:00100000:3.0:1789185768.418972:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812436096 00000100:00100000:3.0:1789185768.419048:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:3.0:1789185768.419060:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+10:14461:x1876096812436096:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185768.419092:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185768.419123:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272ce9e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d988 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.419259:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272cea5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.419277:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272cea5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.419291:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272cea5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185768.419324:0:14387:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789185768.419328:0:14387:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789185768.419348:0:14387:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272cea5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.419381:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272ce9e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d988 expref: 12 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.419401:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272cea5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d988 expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.419479:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c79055dd600) 00010000:00010000:3.0:1789185768.419482:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789185768.419487:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c793fe04200, rc 0) 00000100:00100000:3.0:1789185768.419578:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+11:14461:x1876096812436096:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 519us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185768.419586:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:1.0:1789185768.429348:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185768.429499:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812436224 00000100:00100000:0.0:1789185768.429512:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812436224 00000100:00100000:0.0:1789185768.429583:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:0.0:1789185768.429597:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+11:14461:x1876096812436224:12345-192.168.202.54@tcp:37:lfs.0 00000100:00100000:0.0:1789185768.443088:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+11:14461:x1876096812436224:12345-192.168.202.54@tcp:37:lfs.0 Request processed in 13475us (13738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185768.443402:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:1.0:1789185768.450578:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185768.450709:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812436480 00000100:00100000:3.0:1789185768.450723:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812436480 00000100:00100000:3.0:1789185768.450798:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:3.0:1789185768.450812:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f0a7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+11:14461:x1876096812436480:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789185768.451311:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f0a7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+12:14461:x1876096812436480:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 499us (747us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789185768.451321:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:1.0:1789185768.513602:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185768.513725:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812436608 00000100:00100000:2.0:1789185768.513738:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812436608 00000100:00100000:2.0:1789185768.513811:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:2.0:1789185768.513822:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+10:14467:x1876096812436608:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789185768.513860:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185768.513887:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272ceac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d98f expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.513989:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ceb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514006:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ceb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514020:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ceb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514036:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272ceba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514043:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272ceba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514051:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272ceba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514176:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6400/0x532743011272cec1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514184:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6400/0x532743011272cec1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514191:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6400/0x532743011272cec1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185768.514235:0:14386:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789185768.514239:0:14386:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789185768.514285:0:14386:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6400/0x532743011272cec1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514309:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ceb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514316:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ceb3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514324:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ceb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514331:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185768.514336:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ceb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514345:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ceb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514358:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7918bab600) 00010000:00010000:2.0:1789185768.514361:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185768.514368:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ceb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514373:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272ceb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514389:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272ceba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514395:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272ceba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514400:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272ceba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514488:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185768.514491:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272ceba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514498:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272ceba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514507:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c7921169100) 00010000:00010000:2.0:1789185768.514509:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185768.514512:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272ceba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514519:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272ceba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514556:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272ceac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d98f expref: 12 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514573:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6400/0x532743011272cec1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d98f expref: 11 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.514581:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c79055dd600) 00010000:00010000:2.0:1789185768.514583:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789185768.514586:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6400, rc 0) 00000100:00100000:2.0:1789185768.514675:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+11:14467:x1876096812436608:12345-192.168.202.54@tcp:101:bash.0 Request processed in 853us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185768.514683:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:2.0:1789185768.532133:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185768.532314:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812436864 00000100:00100000:3.0:1789185768.532330:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812436864 00000100:00100000:3.0:1789185768.532461:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:3.0:1789185768.532473:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+11:14467:x1876096812436864:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1789185768.532501:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185768.532528:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272cec8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d996 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.532685:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272cecf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.532703:0:14387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272cea5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d988 expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.532719:0:14387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272cecf lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.532759:0:14387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272cea5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d988 expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.532775:0:14387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272cea5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d988 expref: 11 pid: 14387 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185768.532791:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc86a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14387:1876096821863040:192.168.202.54@tcp:104: 00000100:00100000:3.0:1789185768.532898:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7929b2d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789185768.541038:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185768.541194:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc86a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14387:1876096821863040:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789185768.541263:0:14387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272cecf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185768.549016:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812436992 00000100:00100000:0.0:1789185768.549037:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812436992 00010000:00010000:2.0:1789185768.549242:0:14372:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272cea5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d988 expref: 12 pid: 14387 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185768.549359:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:2.0:1789185768.549370:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+12:2371:x1876096812436992:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185768.549392:0:14372:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185768.549400:0:14372:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272cea5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d988 expref: 12 pid: 14387 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.549460:0:14372:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272cea5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d988 expref: 12 pid: 14387 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.549487:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04200/0x532743011272cea5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d988 expref: 12 pid: 14387 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.549509:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c79055dd600) 00010000:00010000:2.0:1789185768.549515:0:14372:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272cecf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.549528:0:14372:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272cecf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.549538:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272cecf lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.549582:0:14372:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185768.549658:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+11:2371:x1876096812436992:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 289us (8634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185768.549667:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00010000:00010000:3.0:1789185768.549768:0:14387:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272cecf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.549779:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272cecf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.549809:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ced6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.549821:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ced6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.549841:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ced6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.550765:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272cedd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.550790:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272cedd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.550800:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272cedd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185768.550816:0:14387:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789185768.550854:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272cecf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.550863:0:14387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272cecf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.550871:0:14387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272cecf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.550878:0:14387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe04e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185768.550883:0:14387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272cecf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.550890:0:14387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272cecf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.550901:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c79055dd600) 00010000:00010000:3.0:1789185768.550903:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185768.550908:0:14387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272cecf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.550913:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe04e00/0x532743011272cecf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185768.550922:0:14387:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fcb5aac2 reply state 000000000adc5b92 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ced6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185768.550938:0:14387:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789185768.550990:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05400/0x532743011272cec8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d996 expref: 14 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.551002:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272cedd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d996 expref: 13 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.551007:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:3.0:1789185768.551009:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789185768.551011:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4ce00, rc 0) 00000100:00100000:3.0:1789185768.551056:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+14:14467:x1876096812436864:12345-192.168.202.54@tcp:101:bash.0 Request processed in 18588us (18938us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789185768.551063:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00010000:00010000:2.0:1789185768.559771:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ced6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.559802:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ced6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.559814:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ced6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.559823:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c793fe05000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185768.559831:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ced6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.559840:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ced6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.560121:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c79055ddd00) 00010000:00010000:2.0:1789185768.560125:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185768.560133:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ced6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.560140:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c793fe05000/0x532743011272ced6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185768.576307:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185768.576475:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812437120 00000100:00100000:2.0:1789185768.576489:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812437120 00000100:00100000:2.0:1789185768.576559:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:2.0:1789185768.576575:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+13:14467:x1876096812437120:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1789185768.576609:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185768.576638:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272ceeb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d99d expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.576754:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cef2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.576771:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cef2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.576785:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cef2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185768.576845:0:14386:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789185768.576850:0:14386:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789185768.576873:0:14386:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cef2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.576886:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cef2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.576917:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272ceeb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d99d expref: 15 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.576940:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cef2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d99d expref: 14 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.576950:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:2.0:1789185768.576953:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185768.576958:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6800, rc 0) 00000100:00100000:2.0:1789185768.577035:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+14:14467:x1876096812437120:12345-192.168.202.54@tcp:101:bash.0 Request processed in 466us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185768.577043:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:0.0:1789185768.583225:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185768.583332:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812437376 00000100:00100000:3.0:1789185768.583346:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812437376 00000100:00100000:3.0:1789185768.583470:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:3.0:1789185768.583484:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c595249a-629e-4223-b27d-e43e596c040e+14:14467:x1876096812437376:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:3.0:1789185768.583981:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c595249a-629e-4223-b27d-e43e596c040e+15:14467:x1876096812437376:12345-192.168.202.54@tcp:35:bash.0 Request processed in 499us (781us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789185768.583992:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:0.0:1789185768.756959:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185768.758007:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812437632 00000100:00100000:3.0:1789185768.758019:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812437632 00000100:00100000:3.0:1789185768.758108:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:3.0:1789185768.758119:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+15:14477:x1876096812437632:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1789185768.758161:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185768.758181:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cef9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d9a4 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185768.758296:0:14388:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789185768.758449:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cef9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9a4 expref: 17 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.758464:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7918bab600) 00010000:00010000:3.0:1789185768.758467:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185768.758473:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cef9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9a4 expref: 17 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.758487:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4d400, rc 0) 00000100:00100000:3.0:1789185768.758546:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+16:14477:x1876096812437632:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 428us (1597us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789185768.758554:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:1.0:1789185768.762079:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185768.762389:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812437888 00000100:00100000:3.0:1789185768.762401:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812437888 00000100:00100000:3.0:1789185768.762482:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:3.0:1789185768.762492:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c595249a-629e-4223-b27d-e43e596c040e+16:14477:x1876096812437888:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789185768.762738:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c595249a-629e-4223-b27d-e43e596c040e+17:14477:x1876096812437888:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 247us (669us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789185768.762747:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000040:00080000:3.0:1789185768.850954:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789185768.882784:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185768.883067:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812438144 00000100:00100000:2.0:1789185768.883080:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812438144 00000100:00100000:2.0:1789185768.883153:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:2.0:1789185768.883164:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+17:14480:x1876096812438144:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1789185768.883211:0:15092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185768.883237:0:15092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272cf07 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d9ab expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.883373:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272cf0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.883389:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272cf0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.883449:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272cf0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185768.883463:0:15092:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789185768.883622:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272cf07 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9ab expref: 20 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.883644:0:15092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272cf0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9ab expref: 19 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185768.883653:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:2.0:1789185768.883657:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185768.883661:0:15092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7a00, rc 0) 00000100:00100000:2.0:1789185768.883975:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+19:14480:x1876096812438144:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 811us (1203us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789185768.884008:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:2.0:1789185768.889866:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185768.890040:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812438272 00000100:00100000:3.0:1789185768.890078:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812438272 00000100:00100000:3.0:1789185768.890151:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:3.0:1789185768.890162:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+19:14480:x1876096812438272:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:3.0:1789185768.890272:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cf1c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.890293:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cf1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.890309:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cf1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.890348:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cf1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.890820:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cf1c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.891036:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cf1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.891043:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185768.891049:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cf1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.891059:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cf1c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.891075:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:3.0:1789185768.891079:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185768.891084:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cf1c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185768.891116:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cf1c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185768.894697:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+19:14480:x1876096812438272:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 4517us (4840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185768.894732:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:1.0:1789185768.910539:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185768.910917:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812438400 00000100:00100000:0.0:1789185768.910928:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812438400 00000100:00100000:0.0:1789185768.911006:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:0.0:1789185768.911017:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c595249a-629e-4223-b27d-e43e596c040e+19:2372:x1876096812438400:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185768.911033:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185768.911082:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272cf0e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9ab expref: 19 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185768.911101:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:0.0:1789185768.911106:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185768.911161:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c595249a-629e-4223-b27d-e43e596c040e+18:2372:x1876096812438400:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 147us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185768.911168:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:0.0:1789185768.925580:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185768.926087:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812438656 00000100:00100000:3.0:1789185768.926101:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812438656 00000100:00100000:3.0:1789185768.926176:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:3.0:1789185768.926190:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c595249a-629e-4223-b27d-e43e596c040e+18:14480:x1876096812438656:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1789185768.930233:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c595249a-629e-4223-b27d-e43e596c040e+19:14480:x1876096812438656:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 4027us (4649us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789185768.930254:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00010000:00010000:0.0:1789185769.360002:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185769.360591:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821863168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185769.360713:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185769.360930:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821863168 00000100:00100000:3.0:1789185769.360941:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821863168 00000100:00100000:3.0:1789185769.361028:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789185769.361041:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821863168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185769.361101:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789185769.361158:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821863168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185769.361166:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789185769.361445:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821863168:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789185769.361529:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185769.385245:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185769.385463:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812438912 00000100:00100000:0.0:1789185769.385477:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812438912 00000100:00100000:0.0:1789185769.385558:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:0.0:1789185769.385572:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+19:14511:x1876096812438912:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:0.0:1789185769.385609:0:15092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185769.385641:0:15092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf23 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d9b2 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.385969:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cf2a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.385988:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cf2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.386003:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cf2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185769.386040:0:15092:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789185769.386261:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf23 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9b2 expref: 22 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.386285:0:15092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cf2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9b2 expref: 21 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.386296:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:0.0:1789185769.386299:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185769.386303:0:15092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907355c00, rc 0) 00000100:00100000:0.0:1789185769.386539:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+21:14511:x1876096812438912:12345-192.168.202.54@tcp:101:cat.0 Request processed in 969us (1312us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1789185769.386548:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:1.0:1789185769.395618:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185769.395729:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185769.395846:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812439296 00000100:00100000:2.0:1789185769.395860:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812439296 00000100:00100000:2.0:1789185769.395999:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:2.0:1789185769.396012:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c595249a-629e-4223-b27d-e43e596c040e+21:2371:x1876096812439296:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185769.396037:0:14372:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185769.396081:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cf2a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9b2 expref: 21 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.396115:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:2.0:1789185769.396122:0:14372:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185769.396282:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c595249a-629e-4223-b27d-e43e596c040e+20:2371:x1876096812439296:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 270us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185769.396295:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:0.0:1789185769.396769:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812439168 00000100:00100000:0.0:1789185769.396777:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812439168 00000100:00100000:0.0:1789185769.396819:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:0.0:1789185769.396840:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c595249a-629e-4223-b27d-e43e596c040e+20:14511:x1876096812439168:12345-192.168.202.54@tcp:35:cat.0 00000100:00100000:0.0:1789185769.397276:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c595249a-629e-4223-b27d-e43e596c040e+21:14511:x1876096812439168:12345-192.168.202.54@tcp:35:cat.0 Request processed in 435us (1671us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789185769.397285:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:1.0:1789185769.480673:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185769.481725:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812439552 00000100:00100000:3.0:1789185769.481743:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812439552 00000100:00100000:1.0:1789185769.482084:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:1.0:1789185769.482167:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+21:14517:x1876096812439552:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:1.0:1789185769.482217:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185769.482247:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec400/0x532743011272cf38 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d9b9 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.482449:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec800/0x532743011272cf3f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.482467:0:14388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272cedd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d996 expref: 22 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.482476:0:14388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cef2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d99d expref: 22 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.482485:0:14388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec800/0x532743011272cf3f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.482530:0:14388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cef2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d99d expref: 22 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.482548:0:14388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cef2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d99d expref: 22 pid: 14386 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185769.484039:0:14388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78027d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14388:1876096821863296:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789185769.484568:0:14388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272cedd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d996 expref: 22 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.484587:0:14388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272cedd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d996 expref: 22 pid: 14387 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185769.484598:0:14388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78027d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14388:1876096821863424:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789185769.484651:0:14388:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c790685a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789185769.501687:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185769.502481:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812439680 00000100:00100000:0.0:1789185769.502498:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812439680 00010000:00010000:0.0:1789185769.502560:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cef2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d99d expref: 23 pid: 14386 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185769.502606:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:0.0:1789185769.502638:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792fed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c595249a-629e-4223-b27d-e43e596c040e+23:2371:x1876096812439680:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185769.502657:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185769.502666:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cef2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d99d expref: 23 pid: 14386 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502684:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cef2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d99d expref: 23 pid: 14386 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502713:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:0.0:1789185769.502719:0:14371:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec800/0x532743011272cf3f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502730:0:14371:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec800/0x532743011272cf3f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502738:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185769.502818:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792fed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c595249a-629e-4223-b27d-e43e596c040e+23:2371:x1876096812439680:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 182us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185769.502825:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00010000:00010000:1.0:1789185769.506591:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cef2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d99d expref: 22 pid: 14386 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185769.506627:0:14388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78027d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14388:1876096821863296:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789185769.506641:0:14388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78027d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14388:1876096821863424:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789185769.506676:0:14388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec800/0x532743011272cf3f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185769.509521:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185769.509671:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812439808 00000100:00100000:1.0:1789185769.509685:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812439808 00010000:00010000:1.0:1789185769.509743:0:14372:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272cedd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d996 expref: 22 pid: 14387 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185769.509785:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:1.0:1789185769.509797:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c595249a-629e-4223-b27d-e43e596c040e+22:2371:x1876096812439808:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185769.509817:0:14372:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185769.509836:0:14372:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272cedd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d996 expref: 22 pid: 14387 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.509863:0:14372:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272cedd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d996 expref: 22 pid: 14387 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.509891:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ce00/0x532743011272cedd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d996 expref: 22 pid: 14387 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.509912:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:1.0:1789185769.509938:0:14372:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec800/0x532743011272cf3f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.509950:0:14372:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec800/0x532743011272cf3f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.509958:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec800/0x532743011272cf3f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.510001:0:14372:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185769.510079:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c595249a-629e-4223-b27d-e43e596c040e+21:2371:x1876096812439808:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 283us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185769.510087:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00010000:00010000:3.0:1789185769.510553:0:14388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec800/0x532743011272cf3f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.510578:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec800/0x532743011272cf3f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185769.510603:0:14388:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789185769.510832:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec400/0x532743011272cf38 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9b9 expref: 22 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.510865:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec800/0x532743011272cf3f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9b9 expref: 21 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.510874:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:3.0:1789185769.510877:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789185769.510880:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013ec800, rc 0) 00000100:00100000:3.0:1789185769.510928:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+21:14517:x1876096812439552:12345-192.168.202.54@tcp:101:dd.0 Request processed in 28833us (30271us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789185769.510935:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:2.0:1789185769.517945:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185769.518707:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812440064 00000100:00100000:0.0:1789185769.518723:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812440064 00000100:00100000:0.0:1789185769.518812:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:0.0:1789185769.518835:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+21:14517:x1876096812440064:12345-192.168.202.54@tcp:36:dd.0 00010000:00010000:0.0:1789185769.520035:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf4d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.520058:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.520215:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789185769.520288:0:15092:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1789185769.520320:0:15092:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f581d1db reply state 0000000071bfeaf3 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185769.520332:0:15092:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789185769.520693:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+24:14517:x1876096812440064:12345-192.168.202.54@tcp:36:dd.0 Request processed in 1865us (2758us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789185769.520703:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000020:00080000:0.0:1789185769.520710:0:15092:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789185769.524666:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185769.525319:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812440192 00000100:00100000:3.0:1789185769.525335:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812440192 00000100:00100000:3.0:1789185769.525462:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:3.0:1789185769.525475:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+24:14517:x1876096812440192:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:3.0:1789185769.525508:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185769.525536:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cf54 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d9c0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.525623:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cf54 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9c0 expref: 25 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.525668:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cf54 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9c0 expref: 25 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.525695:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:3.0:1789185769.525699:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789185769.525704:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4d400, rc 0) 00000100:00100000:3.0:1789185769.525776:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+25:14517:x1876096812440192:12345-192.168.202.54@tcp:101:dd.0 Request processed in 304us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185769.525784:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00010000:00010000:0.0:1789185769.534019:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.534046:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.534057:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.534064:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185769.534070:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.534080:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf4d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.534120:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:0.0:1789185769.534123:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185769.534155:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf4d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.534162:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf4d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185769.549560:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185769.549689:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812440448 00000100:00100000:1.0:1789185769.549704:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812440448 00000100:00100000:1.0:1789185769.549814:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:1.0:1789185769.549996:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c595249a-629e-4223-b27d-e43e596c040e+24:14517:x1876096812440448:12345-192.168.202.54@tcp:103:dd.0 00010000:00010000:1.0:1789185769.550025:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185769.550067:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d400/0x532743011272cf54 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9c0 expref: 24 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.550231:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:1.0:1789185769.550238:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185769.550371:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c595249a-629e-4223-b27d-e43e596c040e+23:14517:x1876096812440448:12345-192.168.202.54@tcp:103:dd.0 Request processed in 544us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185769.550380:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:0.0:1789185769.553746:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185769.553956:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812440576 00000100:00100000:2.0:1789185769.553970:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812440576 00000100:00100000:2.0:1789185769.554078:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:2.0:1789185769.554107:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+23:14517:x1876096812440576:12345-192.168.202.54@tcp:58:dd.0 00010000:00010000:2.0:1789185769.554254:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272cf5b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.554296:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272cf5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.554310:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272cf5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789185769.555298:0:14386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185769.555513:0:14386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789185769.555617:0:14386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789185769.555784:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+23:14517:x1876096812440576:12345-192.168.202.54@tcp:58:dd.0 Request processed in 1681us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185769.555796:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:1.0:1789185769.558899:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185769.560218:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812440704 00000100:00100000:0.0:1789185769.560236:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812440704 00000100:00100000:0.0:1789185769.560320:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:0.0:1789185769.560335:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+23:14517:x1876096812440704:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:0.0:1789185769.560364:0:15092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185769.560394:0:15092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf62 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d9c7 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.560501:0:15092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272cf5b lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.560514:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf62 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9c7 expref: 24 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.560539:0:15092:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272cf5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.560557:0:15092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf62 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9c7 expref: 24 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.560574:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:0.0:1789185769.560578:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789185769.560582:0:15092:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf62 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9c7 expref: 24 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.560611:0:15092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7907354000, rc 0) 00000100:00100000:0.0:1789185769.560704:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+24:14517:x1876096812440704:12345-192.168.202.54@tcp:101:dd.0 Request processed in 372us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185769.560712:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00000040:00080000:3.0:1789185769.871670:0:14419:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789185769.871681:0:14419:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185769.871722:0:14419:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789185769.871728:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789185769.872178:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793fc85c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14419:1876096821863552:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789185769.872573:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7929b2da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789185769.878872:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185769.879376:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812440832 00000100:00100000:2.0:1789185769.879396:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812440832 00000100:00100000:2.0:1789185769.879481:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:2.0:1789185769.879491:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c595249a-629e-4223-b27d-e43e596c040e+25:14518:x1876096812440832:12345-192.168.202.54@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789185769.879571:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c595249a-629e-4223-b27d-e43e596c040e+25:14518:x1876096812440832:12345-192.168.202.54@tcp:900:lhsmtool_posix.0 Request processed in 81us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185769.879579:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:3.0:1789185769.886630:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793fc85c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14419:1876096821863552:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789185769.888505:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185769.888598:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812440960 00000100:00100000:0.0:1789185769.888609:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812440960 00000100:00100000:0.0:1789185769.888676:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:0.0:1789185769.888687:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+24:14518:x1876096812440960:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789185769.888718:0:15092:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789185769.888865:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+24:14518:x1876096812440960:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 179us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185769.888873:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:1.0:1789185769.895393:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185769.897311:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812441088 00000100:00100000:2.0:1789185769.897328:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812441088 00000100:00100000:2.0:1789185769.897428:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:2.0:1789185769.897440:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+24:14518:x1876096812441088:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789185769.897514:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7400/0x532743011272cf69 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897550:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7400/0x532743011272cf69 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897563:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7400/0x532743011272cf69 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897580:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cf70 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897586:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cf70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897594:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cf70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897620:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf77 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897628:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897635:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185769.897675:0:14386:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789185769.897680:0:14386:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789185769.897694:0:14386:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897705:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7400/0x532743011272cf69 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897721:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7400/0x532743011272cf69 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897729:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7400/0x532743011272cf69 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897735:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d7400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185769.897740:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7400/0x532743011272cf69 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897761:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7400/0x532743011272cf69 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897773:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7918bab800) 00010000:00010000:2.0:1789185769.897776:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185769.897781:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7400/0x532743011272cf69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897787:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7400/0x532743011272cf69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897800:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cf70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897806:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cf70 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897812:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cf70 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897818:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185769.897826:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cf70 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897832:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cf70 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897840:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9c7921169100) 00010000:00010000:2.0:1789185769.897852:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185769.897856:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cf70 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897862:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6800/0x532743011272cf70 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897878:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897884:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf77 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897890:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897896:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185769.897899:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897905:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf77 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897912:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:2.0:1789185769.897914:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185769.897923:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf77 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.897929:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf77 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185769.898473:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+24:14518:x1876096812441088:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 Request processed in 1032us (3097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185769.898482:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:3.0:1789185769.917228:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185769.918072:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812441344 00000100:00100000:1.0:1789185769.918084:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812441344 00000100:00100000:1.0:1789185769.918148:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:1.0:1789185769.918160:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+24:14518:x1876096812441344:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185769.918182:0:15092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185769.918213:0:15092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed000/0x532743011272cf7e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d9ce expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.918318:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cf85 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.918335:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cf85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.918347:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cf85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185769.918358:0:15092:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789185769.918485:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cf85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.918494:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cf85 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.918502:0:15092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cf85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.918509:0:15092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ed800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185769.918513:0:15092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cf85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.918537:0:15092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cf85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.918549:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:1.0:1789185769.918552:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789185769.918557:0:15092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cf85 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.918563:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cf85 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.918606:0:15092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed000/0x532743011272cf7e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9ce expref: 26 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.918616:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7918bab800) 00010000:00010000:1.0:1789185769.918619:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789185769.918622:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed000/0x532743011272cf7e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9ce expref: 26 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.918631:0:15092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013ed000, rc 0) 00000100:00100000:1.0:1789185769.918703:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+25:14518:x1876096812441344:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 545us (1486us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1789185769.918710:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:0.0:1789185769.931112:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185769.931292:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812441472 00000100:00100000:3.0:1789185769.931303:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812441472 00000100:00100000:3.0:1789185769.931364:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:3.0:1789185769.931375:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+25:14518:x1876096812441472:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789185769.932055:0:14387:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789185769.932209:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+25:14518:x1876096812441472:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 834us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185769.932233:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:1.0:1789185769.946444:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185769.946603:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812441728 00000100:00100000:0.0:1789185769.946613:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812441728 00000100:00100000:0.0:1789185769.946673:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:0.0:1789185769.946684:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+25:14518:x1876096812441728:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185769.946705:0:15092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185769.946728:0:15092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354c00/0x532743011272cf93 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d9d5 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789185769.950120:0:15092:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1789185769.950131:0:15092:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789185769.950224:0:15092:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789185769.951071:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf9a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.951089:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.951102:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.951169:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354c00/0x532743011272cf93 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9d5 expref: 28 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.951197:0:15092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9d5 expref: 27 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.951206:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7921169100) 00010000:00010000:2.0:1789185769.951209:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185769.951213:0:15092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d6e00, rc 0) 00000100:00100000:2.0:1789185769.951451:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+27:14518:x1876096812441728:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 4768us (5055us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789185769.951468:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:1.0:1789185769.967483:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185769.967776:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812441984 00000100:00100000:0.0:1789185769.967788:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812441984 00000100:00100000:0.0:1789185769.968102:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:0.0:1789185769.968114:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+27:14518:x1876096812441984:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789185769.968196:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185769.968226:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6e00/0x532743011272cf9a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9d5 expref: 27 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.968246:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7921169100) 00010000:00010000:0.0:1789185769.968258:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185769.968709:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272cfa8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.968724:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272cfa8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.968734:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272cfa8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.968940:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272cfaf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9f1a72f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.968950:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272cfaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9f1a72f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.968958:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272cfaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9f1a72f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.969200:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272cfa8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.969208:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272cfa8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.969214:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272cfa8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.969228:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185769.969233:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272cfa8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.969241:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272cfa8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.969253:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c79055dd600) 00010000:00010000:0.0:1789185769.969256:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185769.969261:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272cfa8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.969266:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354600/0x532743011272cfa8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.970007:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272cfaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9f1a72f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.970096:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272cfaf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9f1a72f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.970103:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272cfaf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9f1a72f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.970109:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1789185769.970113:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272cfaf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9f1a72f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.970119:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272cfaf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9f1a72f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.970144:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9f1a72f5 (ffff9c79117a4d00) 00010000:00010000:0.0:1789185769.970147:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185769.970151:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272cfaf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9f1a72f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.970158:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354a00/0x532743011272cfaf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9f1a72f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185769.970268:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+26:14518:x1876096812441984:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 2153us (2791us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789185769.973226:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185769.973552:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812442112 00000100:00100000:1.0:1789185769.973562:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812442112 00000100:00100000:1.0:1789185769.973627:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:1.0:1789185769.973654:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+27:14518:x1876096812442112:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185769.973674:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185769.973698:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cfb6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d9dc expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.973733:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec400/0x532743011272cfbd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185769.974131:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00010000:00010000:1.0:1789185769.974484:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec400/0x532743011272cfbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.974500:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec400/0x532743011272cfbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.974603:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed800/0x532743011272cfb6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9dc expref: 28 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.974621:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec400/0x532743011272cfbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9dc expref: 27 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.974630:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7918babf00) 00010000:00010000:1.0:1789185769.974633:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789185769.974636:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79013ec400, rc 0) 00000100:00100000:1.0:1789185769.974708:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+27:14518:x1876096812442112:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1058us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185769.974716:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:1.0:1789185769.985009:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185769.985137:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812442368 00000100:00100000:3.0:1789185769.985146:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812442368 00000100:00100000:3.0:1789185769.985221:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:3.0:1789185769.985230:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+27:14518:x1876096812442368:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789185769.985317:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272cfc4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.985332:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272cfc4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.985344:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272cfc4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789185769.985673:0:14387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1789185769.985683:0:14387:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 467025277001ns, next at 468025274609ns, rc = 0 00000004:00010000:3.0:1789185769.985760:0:14387:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000156501c2 reply state 00000000a397f26c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272cfc4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185769.985769:0:14387:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789185769.985860:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+29:14518:x1876096812442368:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 630us (858us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789185769.985867:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00010000:00010000:2.0:1789185769.993695:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272cfc4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.993710:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272cfc4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.993717:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272cfc4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.993723:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4ca00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1789185769.993727:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272cfc4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.993735:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272cfc4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.993759:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7918babf00) 00010000:00010000:2.0:1789185769.993762:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789185769.993768:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272cfc4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.993774:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4ca00/0x532743011272cfc4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185770.000397:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185770.000567:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812442496 00000100:00100000:3.0:1789185770.000580:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812442496 00000100:00100000:3.0:1789185770.000651:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:3.0:1789185770.000662:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+28:14518:x1876096812442496:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185770.000702:0:15092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185770.000726:0:15092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4da00/0x532743011272cfcb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d9e3 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.000800:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4da00/0x532743011272cfcb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9e3 expref: 29 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.000815:0:15092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4da00/0x532743011272cfcb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9e3 expref: 29 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.000841:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7918babf00) 00010000:00010000:3.0:1789185770.000844:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789185770.000856:0:15092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4da00, rc 0) 00000100:00100000:3.0:1789185770.000912:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+29:14518:x1876096812442496:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 253us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185770.000919:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00080000:2.0:1789185770.001149:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185770.022021:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185770.022133:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812442624 00000100:00100000:1.0:1789185770.022162:0:16267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812442624 00000100:00100000:1.0:1789185770.022322:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:1.0:1789185770.022337:0:16267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c595249a-629e-4223-b27d-e43e596c040e+5:2371:x1876096812442624:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789185770.022763:0:16267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c595249a-629e-4223-b27d-e43e596c040e+6:2371:x1876096812442624:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 430us (753us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789185770.023615:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00080000:2.0:1789185770.026365:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185770.026784:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185770.026983:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812442880 00000100:00100000:1.0:1789185770.026992:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812442880 00000100:00100000:1.0:1789185770.027057:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1789185770.027067:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c595249a-629e-4223-b27d-e43e596c040e+29:14518:x1876096812442880:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789185770.027608:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c595249a-629e-4223-b27d-e43e596c040e+30:14518:x1876096812442880:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 540us (829us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1789185770.027617:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:0.0:1789185770.032513:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185770.032726:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812443136 00000100:00100000:3.0:1789185770.032740:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812443136 00000100:00100000:3.0:1789185770.033202:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:3.0:1789185770.033220:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793ff94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+30:14518:x1876096812443136:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789185770.034656:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793ff94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+30:14518:x1876096812443136:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 1432us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185770.034671:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:3.0:1789185770.051929:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185770.052516:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812443264 00000100:00100000:2.0:1789185770.052530:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812443264 00000100:00100000:2.0:1789185770.052602:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:2.0:1789185770.052617:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+30:14518:x1876096812443264:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185770.052658:0:15092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185770.052687:0:15092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272cfd2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d9ea expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.052799:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272cfd9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.053105:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272cfd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.053124:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272cfd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185770.056561:0:15092:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789185770.056612:0:15092:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272cfd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.056677:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7a00/0x532743011272cfd2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9ea expref: 32 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.056707:0:15092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272cfd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9ea expref: 31 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.056718:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7918babf00) 00010000:00010000:3.0:1789185770.056721:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789185770.056726:0:15092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7800, rc 0) 00000100:00100000:3.0:1789185770.057013:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+31:14518:x1876096812443264:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 4397us (5096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185770.057024:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:2.0:1789185770.064485:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185770.064614:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812443392 00000100:00100000:3.0:1789185770.064628:0:15070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812443392 00000100:00100000:3.0:1789185770.064702:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:3.0:1789185770.064714:0:15070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c595249a-629e-4223-b27d-e43e596c040e+6:2370:x1876096812443392:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185770.064740:0:15070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185770.064767:0:15070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272cfe0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d9f1 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789185770.064802:0:15070:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4cee9, blocks: 0x1 00010000:00010000:3.0:1789185770.064850:0:15070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1789185770.064856:0:15070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185770.064867:0:15070:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272cfe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f1 expref: 7 pid: 15070 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.064911:0:15070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272cfe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f1 expref: 7 pid: 15070 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.064927:0:15070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7936b4d000, rc 0) 00000100:00100000:3.0:1789185770.065011:0:15070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c595249a-629e-4223-b27d-e43e596c040e+7:2370:x1876096812443392:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 300us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185770.065020:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:0.0:1789185770.070629:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185770.070747:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812443648 00000100:00100000:2.0:1789185770.070759:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812443648 00000100:00100000:3.0:1789185770.071163:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:3.0:1789185770.071179:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+31:14518:x1876096812443648:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789185770.071349:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c595249a-629e-4223-b27d-e43e596c040e+31:14518:x1876096812443648:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 174us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185770.071357:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:3.0:1789185770.083715:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185770.083849:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812443776 00000100:00100000:1.0:1789185770.083863:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812443776 00000100:00100000:1.0:1789185770.083939:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:1.0:1789185770.083960:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+31:14518:x1876096812443776:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789185770.139287:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185770.139335:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185770.139363:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185770.139390:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185770.139433:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185770.139469:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812444032 00000100:00100000:0.0:1789185770.139482:0:16267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812444032 00000100:00100000:0.0:1789185770.139550:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812444416 00000100:00100000:0.0:1789185770.139553:0:16267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812444416 00000100:00100000:0.0:1789185770.139570:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812444288 00000100:00100000:0.0:1789185770.139572:0:16267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812444288 00000100:00100000:0.0:1789185770.139590:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:0.0:1789185770.139601:0:16267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c595249a-629e-4223-b27d-e43e596c040e+5:2371:x1876096812444032:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185770.139694:0:16267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c595249a-629e-4223-b27d-e43e596c040e+5:2371:x1876096812444032:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 94us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.139717:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:0.0:1789185770.139737:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:0.0:1789185770.139744:0:16267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+5:2372:x1876096812444416:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185770.139773:0:16267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+5:2372:x1876096812444416:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 30us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.139779:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:0.0:1789185770.139792:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:0.0:1789185770.139799:0:16267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+5:2371:x1876096812444288:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185770.139829:0:16267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+5:2371:x1876096812444288:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 24us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.139835:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00080000:0.0:1789185770.139856:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185770.139861:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185770.140265:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812443904 00000100:00100000:2.0:1789185770.140272:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812443904 00000100:00100000:2.0:1789185770.140315:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:2.0:1789185770.140323:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:2372:x1876096812443904:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1789185770.140357:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bf990f1-01b6-4798-9f3a-975e9044ba2c+13:2372:x1876096812443904:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 36us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185770.140364:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:0.0:1789185770.140593:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812444160 00000100:00100000:0.0:1789185770.140598:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812444160 00000100:00100000:0.0:1789185770.140715:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:0.0:1789185770.140723:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+11:2372:x1876096812444160:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1789185770.140767:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:547a6333-e8a7-4d22-b9c1-94adbcd52c7a+11:2372:x1876096812444160:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 45us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.140775:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00080000:3.0:1789185770.149517:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185770.214759:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c595249a-629e-4223-b27d-e43e596c040e+31:14518:x1876096812443776:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 Request processed in 130787us (131045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185770.214776:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000001:00080000:1.0:1789185770.216060:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:1.0:1789185770.216084:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:1.0:1789185770.216092:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1789185770.216107:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000004:00080000:1.0:1789185770.216122:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789185770.216156:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1789185770.216501:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185770.216523:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821863680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789185770.216598:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185770.217118:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821863680 00000100:00100000:2.0:1789185770.217129:0:16267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821863680 00000100:00100000:2.0:1789185770.217240:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789185770.217251:0:16267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876096821863680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789185770.217501:0:16267:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789185770.217506:0:16267:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789185770.217508:0:16267:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789185770.217510:0:16267:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789185769 -> 1789185769 00002000:00010000:2.0:1789185770.217513:0:16267:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789185770.217566:0:16267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1876096821863680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 317us (967us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789185770.217572:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1789185770.217702:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7936cf1500/2, rc 0, transno 8589934595 00000100:00100000:1.0:1789185770.217709:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1876096821863680:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1789185770.217769:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185770.218103:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185770.218192:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812444544 00000100:00100000:3.0:1789185770.218198:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812444544 00000100:00100000:3.0:1789185770.218243:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:3.0:1789185770.218254:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c595249a-629e-4223-b27d-e43e596c040e+7:2369:x1876096812444544:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789185770.218346:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c595249a-629e-4223-b27d-e43e596c040e+7:2369:x1876096812444544:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185770.218353:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:0.0:1789185770.222228:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185770.222402:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812444800 00000100:00100000:3.0:1789185770.222472:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812444800 00000100:00100000:3.0:1789185770.222541:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:3.0:1789185770.222554:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+14:14518:x1876096812444800:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789185770.222624:0:15092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185770.222657:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d7800/0x532743011272cfd9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9ea expref: 14 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.222680:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7918babf00) 00010000:00010000:3.0:1789185770.222687:0:15092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185770.222724:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272cfe7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.222740:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272cfe7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.222751:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272cfe7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185770.223006:0:15092:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000044a56b9 reply state 000000003bfa9411 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272cfe7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185770.223017:0:15092:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789185770.223157:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c595249a-629e-4223-b27d-e43e596c040e+15:14518:x1876096812444800:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 596us (934us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789185770.223166:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00010000:00010000:3.0:1789185770.226308:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272cfe7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.226332:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272cfe7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.226364:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272cfe7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.226371:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7936b4d600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1789185770.226376:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272cfe7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.226386:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272cfe7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.226436:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7918babf00) 00010000:00010000:3.0:1789185770.226440:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185770.226446:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272cfe7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.226453:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4d600/0x532743011272cfe7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.228971:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185770.231986:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812444928 00000100:00100000:2.0:1789185770.232007:0:16267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812444928 00000100:00100000:2.0:1789185770.232102:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:2.0:1789185770.232116:0:16267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c595249a-629e-4223-b27d-e43e596c040e+7:14518:x1876096812444928:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185770.232141:0:16267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185770.232167:0:16267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272cfee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb050fba70f53d9f8 expref: -99 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.232220:0:16267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272cfe0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f1 expref: 8 pid: 15070 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.232232:0:16267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185770.232236:0:16267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185770.232243:0:16267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272cfee lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f8 expref: 8 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.232289:0:16267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272cfe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f1 expref: 8 pid: 15070 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.232334:0:16267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272cfe0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f1 expref: 8 pid: 15070 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185770.232353:0:16267:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16267:1876096821863808:192.168.202.54@tcp:104: 00000100:00100000:2.0:1789185770.232485:0:16267:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14900 going to sleep for 11 seconds 00000100:00100000:2.0:1789185770.235802:0:16267:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16267:1876096821863808:192.168.202.54@tcp:104: 00010000:00010000:2.0:1789185770.235925:0:16267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272cfee lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f8 expref: 8 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.236629:0:16267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c79234d7800, rc 0) 00000100:00100000:3.0:1789185770.237519:0:16267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c595249a-629e-4223-b27d-e43e596c040e+8:14518:x1876096812444928:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 5398us (8553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185770.237533:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:1.0:1789185770.237662:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185770.237990:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812445056 00000100:00100000:2.0:1789185770.238001:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812445056 00010000:00010000:2.0:1789185770.238060:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272cfe0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f1 expref: 8 pid: 15070 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185770.238103:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:2.0:1789185770.238113:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c595249a-629e-4223-b27d-e43e596c040e+8:2371:x1876096812445056:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185770.238130:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185770.238159:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272cfe0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f1 expref: 8 pid: 15070 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.238178:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272cfe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f1 expref: 8 pid: 15070 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.238232:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b74e754a/0x532743011272cfe0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f1 expref: 8 pid: 15070 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.238253:0:14371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185770.238258:0:14371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185770.238266:0:14371:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272cfee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f8 expref: 7 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.238278:0:14371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272cfee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f8 expref: 7 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.238326:0:14371:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272cfee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f8 expref: 7 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185770.238344:0:14371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7936cf2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14371:1876096821863936:192.168.202.54@tcp:105: 00000100:00100000:2.0:1789185770.238478:0:14371:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14900 going to sleep for 11 seconds 00000100:00100000:2.0:1789185770.241631:0:14371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7936cf2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14371:1876096821863936:192.168.202.54@tcp:105: 00010000:00010000:2.0:1789185770.241670:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185770.241840:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185770.242135:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812445184 00000100:00100000:1.0:1789185770.242145:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812445184 00000100:00100000:1.0:1789185770.242263:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:1.0:1789185770.242276:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7906617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c595249a-629e-4223-b27d-e43e596c040e+8:2371:x1876096812445184:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789185770.242618:0:15068:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789185770.242623:0:15068:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789185768 00002000:00010000:1.0:1789185770.242625:0:15068:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789185767 00002000:00010000:1.0:1789185770.242628:0:15068:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789185769 -> 1789185768 00002000:00010000:1.0:1789185770.242630:0:15068:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789185770.242703:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7906617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c595249a-629e-4223-b27d-e43e596c040e+9:2371:x1876096812445184:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 429us (864us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789185770.242713:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:3.0:1789185770.242767:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c595249a-629e-4223-b27d-e43e596c040e+8:2371:x1876096812445056:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4652us (5104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185770.242778:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1789185770.245107:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185770.245249:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812445312 00000100:00100000:0.0:1789185770.245260:0:15070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812445312 00000100:00100000:0.0:1789185770.245322:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:0.0:1789185770.245333:0:15070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c78027dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c595249a-629e-4223-b27d-e43e596c040e+8:2370:x1876096812445312:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789185770.245384:0:15070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272cff5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.245438:0:15070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272cfee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f8 expref: 8 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.245449:0:15070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185770.245455:0:15070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789185770.245461:0:15070:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272cff5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.245506:0:15070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272cfee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f8 expref: 8 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.245525:0:15070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272cfee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f8 expref: 8 pid: 16267 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.245542:0:15070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7906615c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15070:1876096821864064:192.168.202.54@tcp:104: 00000100:00100000:0.0:1789185770.245643:0:15070:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c79118849c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185770.250141:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185770.250285:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812445440 00000100:00100000:1.0:1789185770.250302:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812445440 00010000:00010000:1.0:1789185770.250368:0:14372:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272cfee lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f8 expref: 9 pid: 16267 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185770.250453:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:1.0:1789185770.250466:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c595249a-629e-4223-b27d-e43e596c040e+9:2372:x1876096812445440:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185770.250484:0:14372:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185770.250513:0:14372:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272cfee lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f8 expref: 9 pid: 16267 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.250532:0:14372:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272cfee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f8 expref: 9 pid: 16267 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.250598:0:14372:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185770.250604:0:14372:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185770.250611:0:14372:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272cff5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.250622:0:14372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272cff5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.250649:0:14372:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185770.250722:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c595249a-629e-4223-b27d-e43e596c040e+9:2372:x1876096812445440:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 259us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185770.250730:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00010000:00010000:0.0:1789185770.251364:0:15070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000235f4ac7/0x532743011272cfee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9f8 expref: 8 pid: 16267 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.251386:0:15070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7906615c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15070:1876096821864064:192.168.202.54@tcp:104: 00010000:00010000:0.0:1789185770.251667:0:15070:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272cff5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.251682:0:15070:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272cff5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.251690:0:15070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272cff5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.251723:0:15070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272cff5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.251731:0:15070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272cff5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.251739:0:15070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272cff5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.251746:0:15070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907354c00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185770.251751:0:15070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272cff5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.251778:0:15070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272cff5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.251797:0:15070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272cff5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.251806:0:15070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000091cbc2b/0x532743011272cff5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.251918:0:15070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c78027dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c595249a-629e-4223-b27d-e43e596c040e+7:2370:x1876096812445312:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 Request processed in 6585us (6821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.252123:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:2.0:1789185770.256657:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185770.256707:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812445696 00000100:00100000:0.0:1789185770.256721:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812445696 00000100:00100000:0.0:1789185770.256786:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:0.0:1789185770.256799:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+14:14518:x1876096812445696:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789185770.257313:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cffc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.257336:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cffc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.257351:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cffc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.257783:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed600/0x532743011272d003 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.257801:0:14386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4da00/0x532743011272cfcb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9e3 expref: 15 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.257810:0:14386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed600/0x532743011272d003 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.257871:0:14386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4da00/0x532743011272cfcb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9e3 expref: 15 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.257893:0:14386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4da00/0x532743011272cfcb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9e3 expref: 15 pid: 15092 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185770.257924:0:14386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78027d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14386:1876096821864192:192.168.202.54@tcp:104: 00000100:00100000:1.0:1789185770.258055:0:14386:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7904dad780 going to sleep for 11 seconds 00000100:00100000:1.0:1789185770.261947:0:14386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78027d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14386:1876096821864192:192.168.202.54@tcp:104: 00010000:00010000:1.0:1789185770.261989:0:14386:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed600/0x532743011272d003 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185770.262065:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1789185770.263335:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812445824 00000100:00100000:3.0:1789185770.263351:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812445824 00010000:00010000:3.0:1789185770.263446:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4da00/0x532743011272cfcb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9e3 expref: 16 pid: 15092 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185770.263521:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:3.0:1789185770.263533:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c595249a-629e-4223-b27d-e43e596c040e+16:2372:x1876096812445824:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185770.263554:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185770.263572:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4da00/0x532743011272cfcb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9e3 expref: 16 pid: 15092 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.263589:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4da00/0x532743011272cfcb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9e3 expref: 16 pid: 15092 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.263618:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7936b4da00/0x532743011272cfcb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9e3 expref: 16 pid: 15092 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.263638:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7918babf00) 00010000:00010000:3.0:1789185770.263644:0:14371:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed600/0x532743011272d003 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.263656:0:14371:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed600/0x532743011272d003 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.263664:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed600/0x532743011272d003 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.263706:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185770.263774:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c595249a-629e-4223-b27d-e43e596c040e+15:2372:x1876096812445824:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 244us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185770.263782:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00010000:00010000:2.0:1789185770.266352:0:14386:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed600/0x532743011272d003 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.266376:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed600/0x532743011272d003 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185770.266719:0:14386:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789185770.266902:0:14386:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789185770.266953:0:14386:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789185770.267060:0:14386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14386:1876096821864320:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789185770.267156:0:14386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185770.267213:0:14386:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b140c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185770.267847:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821864320 00000100:00100000:1.0:1789185770.267860:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821864320 00000100:00100000:1.0:1789185770.267928:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185770.267940:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14386:x1876096821864320:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789185770.268071:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14386:x1876096821864320:12345-0@lo:1000:mdt00_000.0 Request processed in 132us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185770.268080:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185770.270462:0:14386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14386:1876096821864320:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789185770.271324:0:14386:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1789185770.271464:0:14386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14386:1876096821864448:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789185770.271546:0:14386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185770.271593:0:14386:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7905b14900 going to sleep for 11 seconds 00000100:00100000:3.0:1789185770.271635:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821864448 00000100:00100000:3.0:1789185770.271653:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821864448 00000100:00100000:3.0:1789185770.271711:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185770.271722:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14386:x1876096821864448:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789185770.272391:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14386:x1876096821864448:12345-0@lo:1000:mdt00_000.0 Request processed in 669us (843us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789185770.272400:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789185770.272514:0:14386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14386:1876096821864448:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789185770.272561:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed600/0x532743011272d003 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.272574:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed600/0x532743011272d003 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.272583:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed600/0x532743011272d003 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.272591:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ed600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185770.272602:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed600/0x532743011272d003 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.272627:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed600/0x532743011272d003 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.272647:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7918babf00) 00010000:00010000:1.0:1789185770.272651:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789185770.272658:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed600/0x532743011272d003 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.272665:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ed600/0x532743011272d003 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.272711:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272cf5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.272718:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272cf5b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.272725:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272cf5b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.272730:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79234d6a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185770.272733:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272cf5b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.272738:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272cf5b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.272747:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:1.0:1789185770.272750:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789185770.272759:0:14386:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf62 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9c7 expref: 18 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.272784:0:14386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf62 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9c7 expref: 18 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.272794:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf62 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9c7 expref: 18 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.273367:0:14386:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907354000/0x532743011272cf62 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0xb050fba70f53d9c7 expref: 18 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185770.273387:0:14386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c78027d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14386:1876096821864576:192.168.202.54@tcp:105: 00000100:00100000:1.0:1789185770.273617:0:14386:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7904dad600 going to sleep for 11 seconds 00000100:00100000:2.0:1789185770.278698:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185770.278790:0:14386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c78027d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14386:1876096821864576:192.168.202.54@tcp:105: 00000100:00100000:0.0:1789185770.278837:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812445952 00000100:00100000:0.0:1789185770.278865:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812445952 00000100:00100000:0.0:1789185770.278942:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:0.0:1789185770.278965:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f0a6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c595249a-629e-4223-b27d-e43e596c040e+19:14517:x1876096812445952:12345-192.168.202.54@tcp:49:dd.0 00010000:00010000:1.0:1789185770.278993:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272cf5b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.279007:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79234d6a00/0x532743011272cf5b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.279050:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec600/0x532743011272d00a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.279067:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec600/0x532743011272d00a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.279082:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec600/0x532743011272d00a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.279093:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec600/0x532743011272d00a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.279148:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f0a6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c595249a-629e-4223-b27d-e43e596c040e+19:14517:x1876096812445952:12345-192.168.202.54@tcp:49:dd.0 Request processed in 186us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.279159:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00010000:00010000:1.0:1789185770.285095:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec600/0x532743011272d00a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.285131:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec600/0x532743011272d00a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.285261:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ec600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185770.285268:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec600/0x532743011272d00a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.285280:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec600/0x532743011272d00a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.285313:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:1.0:1789185770.285316:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185770.285323:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec600/0x532743011272d00a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.285331:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c79013ec600/0x532743011272d00a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.285360:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cffc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.285368:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cffc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.285374:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cffc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.285378:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1789185770.285506:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cffc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.285513:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cffc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.285522:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c79055dd500) 00010000:00010000:1.0:1789185770.285526:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789185770.285529:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cffc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.285535:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355c00/0x532743011272cffc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789185770.286015:0:14419:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789185770.286022:0:14419:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185770.286065:0:14419:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789185770.286072:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789185770.286586:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c595249a-629e-4223-b27d-e43e596c040e+18:14518:x1876096812445696:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 29782us (29933us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789185770.286599:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00000020:00080000:1.0:1789185770.286606:0:14386:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789185770.304081:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185770.304285:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812446208 00000100:00100000:0.0:1789185770.304299:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812446208 00000100:00100000:0.0:1789185770.304373:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:0.0:1789185770.304387:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c595249a-629e-4223-b27d-e43e596c040e+18:14518:x1876096812446208:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789185770.310662:0:14390:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789185770.310797:0:14390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789185770.310894:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272d011 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.310917:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272d011 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.310932:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272d011 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.310942:0:14390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272d011 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.310949:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272d011 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.310956:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272d011 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.310995:0:14390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789185770.311137:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c595249a-629e-4223-b27d-e43e596c040e+20:14518:x1876096812446208:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 6748us (7065us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789185770.311149:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000020:00080000:0.0:1789185770.311157:0:14390:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789185770.313918:0:15670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185770.313936:0:15670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272d011 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.313955:0:15670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355800 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185770.313961:0:15670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272d011 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.313972:0:15670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272d011 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.313995:0:15670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7918babf00) 00010000:00010000:1.0:1789185770.313999:0:15670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789185770.314032:0:15670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272d011 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.314039:0:15670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7907355800/0x532743011272d011 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.314064:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185770.314066:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185770.314068:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185770.383677:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185770.698474:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185770.698520:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185770.698624:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185770.700358:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812446464 00000100:00100000:1.0:1789185770.700374:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812446464 00000100:00100000:1.0:1789185770.700455:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812446592 00000100:00100000:1.0:1789185770.700459:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812446592 00000100:00100000:1.0:1789185770.700471:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812446336 00000100:00100000:1.0:1789185770.700474:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812446336 00000100:00100000:1.0:1789185770.700495:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:1.0:1789185770.700507:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c595249a-629e-4223-b27d-e43e596c040e+9:2372:x1876096812446464:12345-192.168.202.54@tcp:4:dd.0 00002000:00010000:1.0:1789185770.700568:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa4cee8, atime: 0x6aa4cee7, ctime: 0x6aa4cee8, blocks: 0x1 00010000:00010000:1.0:1789185770.700580:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002081d012/0x532743011272d018 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.700600:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1789185770.700605:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185770.700612:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002081d012/0x532743011272d018 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.700629:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002081d012/0x532743011272d018 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185770.789229:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:3.0:1789185770.789440:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:3.0:1789185770.789573:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:0.0:1789185770.789612:0:15075:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1789185770.789618:0:15075:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789185768 -> 1789185769 00002000:00010000:0.0:1789185770.789621:0:15075:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:0.0:1789185770.789639:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002081d012/0x532743011272d018 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.789652:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002081d012/0x532743011272d018 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.789663:0:15075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002081d012/0x532743011272d018 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.789671:0:15075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ec600 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185770.789677:0:15075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002081d012/0x532743011272d018 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.789687:0:15075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002081d012/0x532743011272d018 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.789712:0:15075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002081d012/0x532743011272d018 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.789733:0:15075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002081d012/0x532743011272d018 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.789869:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c595249a-629e-4223-b27d-e43e596c040e+7:2372:x1876096812446464:12345-192.168.202.54@tcp:4:dd.0 Request processed in 89357us (91402us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789185770.789880:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:0.0:1789185770.790535:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:0.0:1789185770.790559:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c595249a-629e-4223-b27d-e43e596c040e+6:2372:x1876096812446592:12345-192.168.202.54@tcp:4:dd.0 00002000:00010000:0.0:1789185770.790604:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6aa4cee9, atime: 0x6aa4cee7, ctime: 0x0, blocks: 0x807 00010000:00010000:0.0:1789185770.790610:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d01f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.790621:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=467s v=(0 0) 00010000:00010000:0.0:1789185770.790625:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185770.790631:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d01f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.790642:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d01f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185770.907376:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:0.0:1789185770.907796:0:15075:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1789185770.907803:0:15075:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:0.0:1789185770.907891:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d01f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.907995:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d01f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.908006:0:15075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d01f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.908015:0:15075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355800 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185770.908021:0:15075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d01f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.908032:0:15075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d01f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.908060:0:15075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d01f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.908070:0:15075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d01f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.908297:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c595249a-629e-4223-b27d-e43e596c040e+6:2372:x1876096812446592:12345-192.168.202.54@tcp:4:dd.0 Request processed in 117737us (209768us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789185770.908310:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:0.0:1789185770.908355:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:0.0:1789185770.908370:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c595249a-629e-4223-b27d-e43e596c040e+5:2369:x1876096812446336:12345-192.168.202.54@tcp:4:dd.0 00002000:00010000:0.0:1789185770.908844:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aa4cee9, atime: 0x6aa4cee7, ctime: 0x0, blocks: 0x1007 00010000:00010000:0.0:1789185770.908862:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272d026 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.908878:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=467s v=(0 0) 00010000:00010000:0.0:1789185770.908883:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185770.908891:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272d026 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.908905:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272d026 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185770.922864:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1789185770.925863:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185770.926315:0:15074:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789185770.927031:0:15076:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789185770.928280:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1789185770.930275:0:15074:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789185770.930439:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812446720 00000100:00100000:0.0:1789185770.930454:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812446720 00000100:00100000:0.0:1789185770.930535:0:15074:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789185770.930555:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812446848 00000100:00100000:0.0:1789185770.930558:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812446848 00000100:00100000:0.0:1789185770.934637:0:16621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:0.0:1789185770.934664:0:16621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c595249a-629e-4223-b27d-e43e596c040e+10:2369:x1876096812446720:12345-192.168.202.54@tcp:4:dd.0 00010000:00010000:0.0:1789185770.934721:0:16621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d02d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.934745:0:16621:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185770.934750:0:16621:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185770.934758:0:16621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d02d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.934775:0:16621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d02d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185770.935440:0:15076:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1789185770.940591:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185770.950722:0:15074:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789185770.952975:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1789185770.960028:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812446976 00000100:00100000:1.0:1789185770.960046:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812446976 00000100:00100000:1.0:1789185770.960106:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812447104 00000100:00100000:1.0:1789185770.960111:0:15076:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812447104 00000100:00100000:1.0:1789185770.963505:0:15076:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789185770.963530:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096812447232 00000100:00100000:1.0:1789185770.963542:0:15076:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096812447232 00000100:00100000:1.0:1789185770.977614:0:16622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:1.0:1789185770.977637:0:16622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793f25dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c595249a-629e-4223-b27d-e43e596c040e+14:2370:x1876096812446848:12345-192.168.202.54@tcp:4:dd.0 00010000:00010000:1.0:1789185770.977689:0:16622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000798f2a15/0x532743011272d034 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.977712:0:16622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789185770.977717:0:16622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185770.977725:0:16622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000798f2a15/0x532743011272d034 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.977744:0:16622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000798f2a15/0x532743011272d034 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185771.030101:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1789185771.031577:0:15075:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:0.0:1789185771.031588:0:15075:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1789185771.031607:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272d026 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.031624:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272d026 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.031634:0:15075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272d026 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.031642:0:15075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355c00 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185771.031648:0:15075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272d026 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.031658:0:15075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272d026 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.031684:0:15075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272d026 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.031692:0:15075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036f16ac7/0x532743011272d026 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185771.031808:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c595249a-629e-4223-b27d-e43e596c040e+16:2369:x1876096812446336:12345-192.168.202.54@tcp:4:dd.0 Request processed in 123437us (333176us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789185771.033760:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:0.0:1789185771.033819:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:0.0:1789185771.033905:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7936b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c595249a-629e-4223-b27d-e43e596c040e+15:2369:x1876096812447104:12345-192.168.202.54@tcp:4:dd.0 00010000:00010000:0.0:1789185771.034253:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8784886/0x532743011272d03b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.034276:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185771.034281:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185771.034289:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8784886/0x532743011272d03b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.034307:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8784886/0x532743011272d03b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185771.108911:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:2.0:1789185771.108980:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:1.0:1789185771.109475:0:16621:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:1.0:1789185771.109481:0:16621:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:1.0:1789185771.109499:0:16621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d02d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.109514:0:16621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d02d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.109536:0:16621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d02d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.109544:0:16621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355800 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185771.109549:0:16621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d02d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.109559:0:16621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d02d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.109585:0:16621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d02d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.109593:0:16621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005af1dcd4/0x532743011272d02d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185771.109703:0:16621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c595249a-629e-4223-b27d-e43e596c040e+13:2369:x1876096812446720:12345-192.168.202.54@tcp:4:dd.0 Request processed in 175042us (186847us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789185771.109714:0:16621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:1.0:1789185771.109752:0:16621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:1.0:1789185771.109766:0:16621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c793fc85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c595249a-629e-4223-b27d-e43e596c040e+12:2370:x1876096812446976:12345-192.168.202.54@tcp:4:dd.0 00010000:00010000:1.0:1789185771.109805:0:16621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf666626/0x532743011272d042 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.109840:0:16621:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185771.109851:0:16621:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185771.109860:0:16621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf666626/0x532743011272d042 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.109874:0:16621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf666626/0x532743011272d042 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.110030:0:16622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000798f2a15/0x532743011272d034 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.110037:0:16622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000798f2a15/0x532743011272d034 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.110042:0:16622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000798f2a15/0x532743011272d034 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.110045:0:16622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ed600 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:1.0:1789185771.110048:0:16622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000798f2a15/0x532743011272d034 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.110052:0:16622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000798f2a15/0x532743011272d034 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.110059:0:16622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000798f2a15/0x532743011272d034 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.110063:0:16622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000798f2a15/0x532743011272d034 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185771.110100:0:16622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793f25dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c595249a-629e-4223-b27d-e43e596c040e+12:2370:x1876096812446848:12345-192.168.202.54@tcp:4:dd.0 Request processed in 132473us (184251us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1789185771.110105:0:16622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:1.0:1789185771.110117:0:16622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:1.0:1789185771.110125:0:16622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7904d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c595249a-629e-4223-b27d-e43e596c040e+11:2370:x1876096812447232:12345-192.168.202.54@tcp:4:dd.0 00010000:00010000:1.0:1789185771.110263:0:16622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272d049 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.110270:0:16622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185771.110273:0:16622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185771.110276:0:16622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272d049 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.110283:0:16622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272d049 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185771.185452:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:3.0:1789185771.188266:0:15075:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1789185771.188283:0:15075:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 16391 00010000:00010000:3.0:1789185771.188304:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8784886/0x532743011272d03b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.188322:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8784886/0x532743011272d03b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.188333:0:15075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8784886/0x532743011272d03b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.188342:0:15075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7907355200 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185771.188349:0:15075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8784886/0x532743011272d03b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.188375:0:15075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8784886/0x532743011272d03b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.188429:0:15075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8784886/0x532743011272d03b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.188440:0:15075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8784886/0x532743011272d03b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185771.188559:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7936b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c595249a-629e-4223-b27d-e43e596c040e+13:2369:x1876096812447104:12345-192.168.202.54@tcp:4:dd.0 Request processed in 154723us (247974us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789185771.188569:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000001:00080000:2.0:1789185771.235623:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:2.0:1789185771.235654:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1789185771.236125:0:16622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272d049 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.236218:0:16622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272d049 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.236230:0:16622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272d049 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.236238:0:16622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ed000 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:3.0:1789185771.236243:0:16622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272d049 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.236272:0:16622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272d049 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.236296:0:16622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272d049 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.236305:0:16622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000846fb101/0x532743011272d049 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185771.236517:0:16622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7904d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c595249a-629e-4223-b27d-e43e596c040e+7:2370:x1876096812447232:12345-192.168.202.54@tcp:4:dd.0 Request processed in 126385us (283547us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789185771.236529:0:16622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00010000:00010000:0.0:1789185771.236653:0:16621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf666626/0x532743011272d042 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.236664:0:16621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf666626/0x532743011272d042 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.236671:0:16621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf666626/0x532743011272d042 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.236678:0:16621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c79013ed800 already unused, calling callback (ffffffffc17408b0) 00010000:00010000:0.0:1789185771.236682:0:16621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf666626/0x532743011272d042 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.236702:0:16621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf666626/0x532743011272d042 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.236715:0:16621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf666626/0x532743011272d042 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.236721:0:16621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf666626/0x532743011272d042 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185771.236764:0:16621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c793fc85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c595249a-629e-4223-b27d-e43e596c040e+5:2370:x1876096812446976:12345-192.168.202.54@tcp:4:dd.0 Request processed in 127003us (308491us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789185771.236771:0:16621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00010000:00010000:0.0:1789185771.408281:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185772.435921:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58cff117-25e2-45dd-b12f-8a52f6f341b2:3279:1876096821864832:0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.436025:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185772.436075:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821865344:0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.436099:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185772.436138:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789185772.436143:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7904d5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821864704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185772.436181:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185772.436199:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821865216:0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.436219:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185772.436255:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821865344 00000100:00100000:3.0:1789185772.436265:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821865344 00000100:00100000:3.0:1789185772.436333:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821865216 00000100:00100000:3.0:1789185772.436354:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821865216 00000100:00100000:3.0:1789185772.436383:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185772.436394:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821865344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.436492:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876096821865344:12345-0@lo:400:kworker.0 Request processed in 99us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185772.436500:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185772.436521:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789185772.436528:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821865216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.436554:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876096821865216:12345-0@lo:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185772.436560:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789185772.436579:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821864704 00000100:00100000:3.0:1789185772.436582:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821864704 00000100:00100000:3.0:1789185772.436608:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789185772.436615:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821864704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185772.436649:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 8519680 granted 64684032 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789185772.436683:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876096821864704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185772.436689:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789185772.436706:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789185772.436711:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185772.436754:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1789185772.436761:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7936cf1500, transno 8589934595 00000004:00080000:3.0:1789185772.436773:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1789185772.436804:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7904d5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1876096821864704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185772.436817:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876096821865216:0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.436837:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1876096821865344:0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.437360:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821865088:0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.437397:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185772.437451:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789185772.437458:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c792ff5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821864960:0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.437478:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185772.437502:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c780247ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821865472:0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.437525:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185772.437558:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821865472 00000100:00100000:3.0:1789185772.437564:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821865472 00000100:00100000:3.0:1789185772.437602:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789185772.437609:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821865472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.437649:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876096821865472:12345-0@lo:400:kworker.0 Request processed in 41us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185772.437656:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789185772.437677:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185772.437698:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1876096821865472:0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.437733:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821864832 00000100:00100000:3.0:1789185772.437738:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821864832 00000100:00100000:3.0:1789185772.437764:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789185772.437771:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c792f81c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:3279:x1876096821864832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.437807:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c792f81c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cff117-25e2-45dd-b12f-8a52f6f341b2+19:3279:x1876096821864832:12345-0@lo:400:kworker.0 Request processed in 36us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185772.437813:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789185772.437848:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58cff117-25e2-45dd-b12f-8a52f6f341b2:3279:1876096821864832:0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.437884:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821865088 00000100:00100000:3.0:1789185772.437888:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821865088 00000100:00100000:3.0:1789185772.437912:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821864960 00000100:00100000:3.0:1789185772.437914:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821864960 00000100:00100000:3.0:1789185772.437937:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789185772.437943:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821865088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.437979:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821865088:12345-0@lo:400:kworker.0 Request processed in 36us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185772.437985:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789185772.437996:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789185772.438002:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821864960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.438028:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821864960:12345-0@lo:400:kworker.0 Request processed in 26us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185772.438034:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789185772.438050:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185772.438065:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c792ff5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821864960:0@lo:400:kworker.0 00000100:00100000:3.0:1789185772.438074:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c780247ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821865088:0@lo:400:kworker.0 00010000:00010000:0.0:1789185772.440009:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789185773.115027:0:16659:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1789185773.455988:0:15670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185774.480455:0:15669:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185774.481155:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821865600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185774.481247:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185774.481391:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096821865600 00000100:00100000:0.0:1789185774.481401:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096821865600 00000100:00100000:0.0:1789185774.481505:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789185774.481517:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c780247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821865600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789185774.481577:0:15071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789185774.481863:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c780247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876096821865600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 347us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185774.481871:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789185774.481896:0:14382:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185774.481960:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c793f25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1876096821865600:0@lo:13:osp-pre-0-0.0 Debug log: 29474 lines, 29474 kept, 0 dropped, 0 bad.